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Foreword 



Process systems constitute a key aspect of human activity that is closely 
linked to the three pillars of sustainable development: Economic competi- 
tiveness, Social importance (employment, quality of life) and Environmental 
impact. The future economic strength of societies will depend on the ability 
of production industries to produce goods and services by combining compet- 
itiveness with quality of life and environmental awareness. In the combined 
effort to minimize waste through process integration and to optimally oper- 
ate the constructed processes nonlinear behaviours are being exploited. Thus 
there will be an increasing need for nonlinear process theory to systemati- 
cally deal with the relatively complex nonlinear issues that appear with the 
increasing process systems complexity dictated by our technological capabil- 
ity and the competitive demands. 

This book serves as a most promising source that combines process sys- 
tems engineering with nonlinear systems and control theory. This combina- 
tion is carried through in the book by providing the reader with references 
to linear time invariant control theory. The nonlinear passivity theory con- 
stitutes a particularly promising contribution that is illustrated on problems 
of relatively low dimensionality. 

The successful establishment of the state-of-art in nonlinear process sys- 
tems control in a concise textbook represents a laudable contribution to pro- 
cess systems theory for the benefit of future graduate students and researchers 
and hopefully also for the benefit of human activity. 



Lyngby, July 2003 
Professor Sten Bay Jprgensen 

Director of CAPEC (Computer Aided Process Engineering Center) 
Department of Chemical Engineering 
Technical University of Denmark 
Lyngby, Denmark 




Series Editors’ Foreword 



The topics of control engineering and signal processing continue to flourish 
and develop. In common with general scientific investigation, new ideas, 
concepts and interpretations emerge quite spontaneously and these are then 
discussed, used, discarded or subsumed into the prevailing subject paradigm. 
Sometimes these innovative concepts coalesce into a new sub-discipline 
within the broad subject tapestry of control and signal processing. This 
preliminary battle between old and new usually takes place at conferences, 
through the Internet and in the journals of the discipline. After a little more 
maturity has been acquired by the new concepts then archival publication as 
a scientific or engineering monograph may occur. 

A new concept in control and signal processing is known to have arrived 
when sufficient material has evolved for the topic to be taught as a 
specialised tutorial workshop or as a course to undergraduate, graduate or 
industrial engineers. Advanced Textbooks in Control and Signal Processing 
are designed as a vehicle for the systematic presentation of course material 
for both popular and innovative topics in the discipline. It is hoped that 
prospective authors will welcome the opportunity to publish a structured and 
systematic presentation of some of the newer emerging control and signal 
processing technologies in the textbook series. 

As most of the problems from linear control analysis have found solutions, 
advances in future control performance will come from accommodating the 
non-linear nature of many processes more directly. This is a challenge facing 
many areas of control engineering. In the process industries there is a fair 
amount of non-linear model information and the task is to find ways to 
exploit this knowledge base. On the other hand the analysis of non-linear 
systems per se is reasonably well developed but in many cases the move to 
more routine application of these techniques still remains to be taken. We 
believe it is only by having the utility and advantages of non-linear control 
demonstrated in practical applications that the non-linear control paradigm 
will begin to make a contribution to control engineering. 
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Series Editors’ Foreword 



Process control is one area where there is the possibility of demonstrating 
a major advance through the use of non-linear control. Tackling this 
challenge we are pleased to have this textbook by Katalin Hangos, Jozsef 
Bokor, and Gabor Szederkenyi on “Analysis and control of non-linear process 
systems” in the Advanced Textbooks in Control and Signal Processing series. 
It is a text based on past course experience and care has been taken to 
enhance the accessibility of the material with nice pedagogical features like 
special indexes, boxed important definitions and end-of-chapter exercises. The 
underlying rigour of the non-linear analysis has however been preserved. The 
book is suitable for graduate and postgraduate courses in process systems 
engineering and for self-study at that level. It is our hope that this textbook 
will contribute to the more widespread acceptance of non-linear control in 
applications. 



M.J. Grimble and M.A. Johnson 
Industrial Control Centre 
Glasgow, Scotland, U.K. 

Summer 2003 
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1. Introduction 



Process control is a traditional area in process systems engineering which is 
of great practical importance. Control usually involves other related fields, 
like dynamic modeling, identification, diagnosis, etc. 

The majority of practical control applications are mainly based on PID 
loops; there are only a few advanced control systems, either for operating 
units (equipment) with complex or unstable dynamic behavior, or plantwide 
optimizing control. 

It is widely known in process systems engineering that almost all 
process systems are nonlinear in nature. 



Therefore advanced process control should necessarily use nonlinear con- 
trol techniques. 



1.1 A Brief Overview of Nonlinear Process Control 

Elementary or introductory control courses for both control (electrical) and 
process engineers are almost entirely based on linear systems', this is what we 
all start with. The reason for this is twofold. First of all, there are relatively 
simple closed analytical solutions to many control problems (including LQR 
and pole-placement controller design, Kalman-filtering, model parameter and 
structure estimation, etc.), so the linear theory is nice, transparent and fea- 
sible. On the other hand, practical applications are also based on linear or 
linearized models in most cases and handle nonlinearities only when it is 
absolutely unavoidable. 

The common way of controlling process systems with strong nonlinear 
character is to apply model-based predictive controllers where a detailed dy- 
namic process model is used in an optimization framework. The popularity 
of model-based predictive control is partially explained by the fact that it fits 
so well into the “culture” of process systems engineering: it uses traditional 
dynamic process models which are usually available for design and/or sim- 
ulation purposes. At the same time, model-based predictive control is being 
criticized by control engineers because of its lack or weakness of theoretical 
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background, having no guarantee of convergence, stability, robustness, etc. 
in the general case. 

Modern heuristic black-box-type control approaches, such as neural nets 
and fuzzy controllers, have also appeared recently even in industrial practice. 
At the same time, the results and approaches of modern nonlinear control the- 
ory have not earned acceptance in the field of process control. There are two 
reasons. Firstly, these techniques require an advanced mathematical back- 
ground and skills, which are rarely taught to process engineers. Secondly, 
modern nonlinear control methods are computationally hard, and are only 
feasible for small-scale systems in the general case. 

These problems with nonlinear control techniques applied in the gen- 
eral case indicate that a solid knowledge of the special characteristics of the 
nonlinear system in question may significantly help in developing nonlinear 
controllers for process systems with reasonably realistic complexity. There- 
fore, any work in the area of nonlinear process control should be based on 
an interdisciplinary approach that integrates the results and techniques of 
process systems engineering with nonlinear systems and control theory. The 
interdisciplinary nature of this approach behooves us to present an overview 
of the existing literature in both fields from a special integrating viewpoint. 

There are excellent and widely used textbooks where the nonlinear anal- 
ysis and control techniques are presented, such as: 

1. H. Nijmeijer and A.J. Van der Sclraft (1990) Nonlinear Dynamical Con- 
trol Systems, Springer. 

2. A. Isidori (1995) Nonlinear Control Systems I. -II. (Communication and 
Control Engineering Series), Springer. 

3. A.J. van der Schaft (1999) L2-Gain and Passivity Techniques in Nonlin- 
ear Control (Communication and Control Engineering Series), Springer. 

The above textbooks intend to cover a range of nonlinear analysis and con- 
trol techniques in an abstract mathematical way, concentrating on the aspects 
relevant for refining or developing further the techniques. Also, the intended 
readers are graduate and postgraduate students specializing in control engi- 
neering or in applied mathematics. Therefore these books do not meet the 
needs of process engineering students interested in the application of these 
methods for process systems. 

There are also application oriented textbooks available on the market 
dealing with nonlinear control, such as [10], [66] and [60]. These books cover 
a wide range of application areas, therefore they cannot take the specialities of 
process systems into account and do not build on the engineering knowledge 
readily available in the field. 
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1.2 Aims and Objectives 

This textbook has been written for graduate and postgraduate students with 
a process engineering background. It aims to bridge the gap between process 
systems engineering and advanced nonlinear control theory by: 

• providing the necessary mathematical preliminaries for graduate and post- 
graduate students with a process engineering background, 

• presenting the relevant and promising theory and methods for analyzing 
and controlling nonlinear process systems, 

• emphasizing the importance and use of process knowledge, mainly process 
models developed from first engineering principles, for obtaining feasible 
and effective special cases of the general methods. 

The textbook deals with the basic concepts and with the most promising 
tools and techniques in nonlinear process analysis and control illustrated by 
simple examples and tutorial material. 

The notions and techniques are always introduced and illustrated in 
the standard finite dimensional linear time-invariant continuous case, which 
serves as a basis for an extension to the nonlinear case. This way, the neces- 
sary links are also established with more widely known material, which makes 
the understanding of the concepts and methods a lot easier. 

The Level of the Text. The level corresponds to graduate or postgraduate 
courses in process systems engineering. 

The interdisciplinary and rapidly developing nature of the topic as well 
as the broad and diverse background of the potential readers requires us 
to restrict the prerequisite knowledge to a necessary minimum. Only basic 
higher mathematics common in engineering courses, such as linear algebra 
and elementary calculus are assumed. A solid knowledge of process modeling 
and control are advisable. 

The advanced mathematical tools and notions we build upon are summa- 
rized in Appendix A of the textbook. 

Learning Aids. This book is primarily a textbook. Therefore we provide 
special learning tools in order to make its use more comfortable for both 
lecturers and students of a course in analysis and control of nonlinear process 
systems. These include: 

• an Index containing the special terms, definitions, methods and other 
important knowledge elements in the book, 

• a List of Definitions, which is a special index for the most important 
terms and notions in the book, 

• simple worked in-text examples, which have the following format: 
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Example 1.2.1 (Example of examples) 

A simple example 



• a List of Examples of the above which is another special index, 

• learning aid sections, such as Summary, Questions and Application 
Exercises at the end of each chapter, 

• an additional learning aid section Further Reading at the end of each 
non-introductory chapter (Chapters 5-12), 

• a simple typographical scheme to distinguish important terms, definitions 
and statements in the text in the form: 



This is an important knowledge item. 



1.3 The Road Map of the Book 

The material is divided into three logical parts: 

• Control- oriented modeling of concentrated parameter nonlinear systems 
(Chapters 1-5). 

The basic notions of systems and signals are presented first in Chapter 2. 
Thereafter linear and nonlinear state-space models are discussed (Chapter 
3). The construction and the special structure of dynamic process models 
is described in Chapter 4. Chapter 5 is devoted to input-output models 
important for some of the analysis and control techniques later on, 

• Nonlinear system analysis methods and tools (Chapters 6-8). 

The most important nonlinear analysis methods for controllability, observ- 
ability and stability are described first (Chapters 6 and 7). Chapter 8 is 
devoted to passivity analysis and the Hamiltonian description, which are 
powerful concepts with an important physical basis in the case of process 
systems, 

• Nonlinear feedback control (Chapters 9-12). 

An introductory chapter (Chapter 9) deals with the basic notions and tech- 
niques for state feedback control, in particular pole-placement and LQR 
control of linear time-invariant systems. Thereafter separate chapters deal 
with the most important special techniques for nonlinear process control: 
feedback and input-output linearization, passivation and stabilization and 
loop-shaping based on the Hamiltonian view. 

Finally, the necessary mathematical preliminaries not contained in a standard 
process engineering curriculum, namely coordinate transformations, norms, 
Lie-derivatives and -products, distributions as well as co-distributions are 
summarized in Appendix A. 
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The road map of the book, which shows using arrows the dependence of 
the material presented in the chapters, is depicted in Figure 1.1. Directed 
paths show how to proceed when taking a tour through the material: either 
by giving/taking a course or by self- learning. 

The dashed arrows connecting Chapter 4 “Dynamic process models” to 
the other chapters indicate that each non- introductory chapter contains at 
least one section where process system case studies are described. 




Figure 1.1. The road map of the book 



The first draft version of this material was used for an intensive four-week 
postgraduate course taught for process engineers in the CAPEC Center, De- 
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partment of Chemical Engineering, Technical University of Denmark (Lyn- 
gby, Denmark) in 2000. 

Part of the material has been used for an elective course entitled “Mod- 
ern control methods” taught for information engineers at the University of 
Veszprem, Hungary since 2003. 




2. Basic Notions of Systems and Signals 



Signals and systems are basic notions of systems and control theory. There- 
fore, we briefly summarize the most important concepts of the mathematical 
description of signals and systems in this introductory chapter in the form 
they are used later on. 

The material in this chapter is presented in two sections: 

• Signals 

Not only the definition and classification of signals, operations on signals 
and the notion of signal spaces are given but the most important special 
signal types are also introduced. 

• Systems 

The most important system classes are defined based on the abstract no- 
tion of systems together with the characterization of their input-output 
stability. 



2.1 Signals 

Signals are the basic elements of mathematical systems theory, because the 
notion of a system depends upon them. 



2.1.1 What is a Signal? 

Generally, a signal is defined as any physical quantity that varies with time, 
space or any other independent variable (s). A signal can be a function of one 
or more independent variables. 

A longer and more application-oriented definition of signals taken from 
[50] is the following: “Signals are used to communicate between humans and 
between humans and machines; they are used to probe our environment to 
uncover details of structure and state not easily observable; and they are used 
to control energy and information.” 




2. Basic Notions of Systems and Signals 



Example 2.1.1 (Simple signals) 



The following examples describe different simple signals. 

• Let us suppose that the temperature a; of a vessel in a pro- 
cess plant is changing with time (measured in seconds) in the 
following way: 

x : Rj i— > R, x(t) = e -t 

We can see that t is the independent variable (time) and x is 
the dependent variable (see Figure 2.1 (/a)). 

• Let us assume that we can observe the temperature x in the first 
example only at integer time instants (seconds). Let us denote 
the observed temperature by y , which therefore can be defined 
as: 



V ■ Nj R, y[n] = e n 
(see Figure 2.1 (/b)). 




Figure 2.1. (/a) Simple continuous time signal and (/b) its discrete time counter- 
part 
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• A complex-valued signal with a complex independent variable 
is, e.g. 

X :C^C, X(s) = 

s + 1 

which is actually the Laplace transform of the first signal x (see 
Subsection 2.1.4). 

• Let us denote the temperature of a point (x, y, z coordinates in 
a Cartesian coordinate system) inside a room at a certain time 
instant t by T(x, y, z, t). It’s easy to see that T is a real-valued 
function of four independent variables and hence it maps from 
R 4 to R. 

• An example of a vector-valued signal with three independent 
variables is the picture of a color TV where the intensity func- 
tions of the red, green and blue colors (I r , I g and /{,) form the 
vector 



I(x, y, t) 



I r (x,y,t) 

Ig{x,y,t) 

h{x,y,t) 



i.e. I : R 3 i— > R 3 . The independent variables in this case are the 
screen coordinates (x and y) and time (t). 



2.1.2 Classification of Signals 

Signals are classified according to the properties of their independent and 
dependent variables. 

Dimensionality of the Independent Variable. The independent vari- 
able can have one or more dimensions. The most common one-dimensional 
case is when the independent variable is time. 

Dimension of the Dependent Variable (Signal). The signal value eval- 
uated at a certain point in its domain can also be one or more dimensional. 

Real— valued and Complex— valued Signals. The value of a signal can 
be either real or complex. The following question naturally arises: why do 
we deal with complex signals? The answer is that the magnitude and angle 
of a complex signal often has clear engineering meaning, which is sometimes 
analytically simpler to deal with. 

Continuous Time and Discrete Time Signals. In systems and control 
theory, one usually has a one-dimensional independent variable set which is 
called time and denoted by T in the general case. 




10 



2. Basic Notions of Systems and Signals 



Continuous time signals take real or complex (vector) values as a function 
of an independent variable that ranges over the real numbers, therefore a 
continuous time signal is a mapping from a subset of R to C", i.e. T C R. 

Discrete time signals take real or complex (vector) values as a function of 
an independent variable that ranges over the integers, hence a discrete time 
signal makes a mapping from N to C", i.e. T C N. 

Bounded and Unbounded Signals. A signal x : R i— > C is bounded if 
|a;(t)| is finite for all t. A signal that does not have this property is unbounded. 

Periodic and Aperiodic Signals. A time-dependent real-valued signal 
x : R i— > R is periodic with period T if x(t + T) = x(t) for all t. A signal that 
does not have this property is aperiodic. 

Even and Odd Signals. Even signals x e and odd signals x 0 are defined as 
x e (t ) = x e (-t) 
x 0 (t) = —x 0 (—t) 

Any signal is a sum of unique odd and even signals. Using x(t) = x e (t) + x 0 (t ) 
and x(—t) = x e (t)—x 0 (t) yields x e (t) = |(x(t) + :c(— t)) and x Q (t ) = |(a;(t) — 
x(-t)). 

2.1.3 Signals of Special Importance 

Some signals are of theoretical and/or practical importance because they are 
used as special test signals in dynamic systems analysis. 

Definition 2.1.1 (Dirac-d or unit impulse function) 

The Dirac-8 or unit impulse function is not a function in the ordinary sense. 
The simplest way it can be defined is by the integral relation 

/ OO 

f(t)S(t)dt = /( 0) (2.1) 

-oo 

where f : Rj i— > R is an arbitrary smooth function. 

The unit impulse is not defined in terms of its values, but by how it acts inside 
an integral when multiplied by a smooth function /. To see that the area of 
the unit impulse function is 1, we can choose f(t) = 1 in the definition. 

The unit impulse function is widely used in science and engineering. The 
following statements illustrate its role from an engineering point of view: 

• impulse of current in time delivers a unit charge instantaneously to an 
electric network, 

• impulse of force in time gives an instantaneous momentum to a mechanical 
system, 

• impulse of temperature gives a unit energy, that of pressure gives a unit 
mass and that of concentration delivers an impulse of component mass to 
a process system, 
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• impulse of mass density in space represents a mass-point, 

• impulse of charge density in space represents a point charge. 

Definition 2.1.2 (Unit step function) 

Integration of the unit impulse gives the unit step function 




S(t)cIt 



which therefore reads as 




0 ift < 0 

1 if t > 0 



(2.2) 



(2.3) 



Example 2.1.2 (Unit impulse and unit step signals) 

Unit impulse as the derivative of the unit step 

As an example of a method for dealing with generalized functions, 
consider the following function: 

x(t) = j t v{t) 

with ?y being the unit step function defined above. Since 77 is dis- 
continuous, its derivative does not exist as an ordinary function, 
but it exists as a generalized function. Let’s put x in an integral 
with a smooth testing function /. 

y(t) = J f(t)^v(t)dt 

and calculate the integral using the integration-by-parts theorem 

r°° d 

y{t) = mn{t)\- 00 - J J^j t f^ dt 

which gives 

y(t) = /( 00 ) ^ = /(°) 

This results in 
f°° d 

J = f(0) 




12 



2. Basic Notions of Systems and Signals 



which, from the defining Equation (2.1), implies that 
W = Jt^t) 

That is, the unit impulse is the derivative of the unit step in a 
generalized function sense. 



2.1.4 Operations on Signals 

Operations on signals are used to derive (possibly more complex) signals from 
elementary signals or to extract some of the important signal properties. 

Elementary Operations. Let v be an n-dimensional vector space with an 
inner product < •, • > v , a£l and x, y : i— > u, i.e. 





~ X\ (t) 






x(t) = 




. y{t) = 






_x n (t)_ 




_ Vn (t) _ 



Sum of signals. The sum of x and y is defined point-wise, i.e. 

(x + y){t) = x(t) + y(t), VteRo (2.4) 

Multiplication by scalar. 

( ax)(t ) = ax(t), Vt G Rj (2-5) 

Inner product of signals. The inner product of x and y is defined as 

(x, y) v {t) = {x(t),y(t)) v , Vt G Rj (2.6) 

If the inner product on v for a, b G v, a = [ai ... a n ] T ,b=[bi, ... b n \ T 
is defined as 

n 

(a, b) = a i b i (2-7) 

i= 1 



then (2.6) simply gives (x,y) v (t) = x T (t)y(t), which is a simple point- 
wise product if dim(jz) = 1. 

Time shifting. For oGR, the time shifting of x is defined as 



T a x(t) = x(t — a) 



(2.8) 
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Causal time shifting. For agK, the causal time shifting differs from ordinary 
time shifting in the fact that the value of the original signal before t = 0 
is not taken into consideration, i. e. 



T c a x{t) = i](t — a)x(t — a) (2.9) 

where 77 is the unit step function defined in Equation (2.3). 

Truncation. The value of a truncated signal after the truncation time T is 
zero, i.e. 



x T {t) 



x(t), 0 < t < T 
0, t>T 



(2.10) 



Convolution. Convolution is a very important binary time-domain oper- 
ation in linear systems theory as we will see later ( e.g . it can be used for 
computing the response of a linear system to a given input). 

Definition 2.1.3 (Convolution of signals) 

Let x,y : Rj 1— > R. The convolution of x and y denoted by x * y is given by 



( x*y)(t ) 



/ x(r)y(t — r)dr 
J 0 



Vf > 0 



( 2 . 11 ) 



Example 2.1.3 (Convolution of simple signals) 



Let us compute the convolution of the signals x, y : R^ 1— > R, 
x(t) = 1, y(t) = e~ *. According to the definition 

(x * y)(t) = f 1 • e~ < ' t ~ T ' > dr = e~ t [e T } t 0 = 1 — e -t 

J 0 

The signals and their convolution are shown in Figure 2.2. 



Laplace Transformation. The main use of Laplace transformation in lin- 
ear systems theory is to transform linear differential equations into algebraic 
ones. Moreover, the transformation allows us to interpret signals and linear 
systems in the frequency domain. 

Definition 2.1.4 (The domain of Laplace transformation) 

The domain A of Laplace transformation is the set of integrable complex- 
valued functions mapping from the set of real numbers whose absolute value 
is not increasing faster than exponentially, i.e. 

A = { / | / : Rq" 1— > C, / is integrable on [0, a] Va > 0 and 
3 Af > 0, a/ € R such that \f(x)\ < Afe afX \/x > 0 } 



(2.12) 
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Figure 2.2. Two signals (x(t) = 1, y(t) = e *') and their convolution 

Definition 2.1.5 (Laplace transformation) 

With the domain defined above, the Laplace transformation of a signal f is 
defined as 

/>00 

£{/}(«) = / f{t)e~ st dt , / € A, s € C (2.13) 

Jo 

The most important properties (among others) of Laplace transformation 
that we will use later are the following: 

Let f,g £ A. Then the following equalities hold 

1. Linearity 

C{c-f}=c-C{f}, cGC (2.14) 

C{f + g} = C{f} + C{g} (2.15) 

2. Laplace transform of the derivative 

C{f'}(s) = s-jr{f}(s)-f( 0+) (2.16) 

3. Convolution theorem 



C{.f * g} = £{.f} ■ C{g} 



(2.17) 
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4. Time shifting 

C{T c a (f)} = e~ as C{f}(s), (2.18) 

5. Modulation 

£{exf}(s) = C{s - A} (2.19) 

where A G C and e\(t) = e xt . 

2.1.5 L q Signal Spaces and Signal Norms 

Signals with similar mathematical properties belong to signal spaces which 
are usually equipped by suitable signal norms. L q spaces are the most fre- 
quently used general signal spaces described below. 

Definition 2.1.6 ( L q spaces, scalar case) 

For q = 1,2,... the signal space L q [ 0, oo) contains the functions f : R,} i— > R, 
which are Lebesgue-measurable (i.e. their generalized integral exists in the 
Lebesgue sense) and satisfy 

\f(t)\ q dt < oo (2.20) 

The magnitude of functions in an L q space is measured using norms (see 
Section A.l in the Appendix for the defining properties of norms). 

Definition 2.1.7 (q-norm, scalar case) 

Let f € L g [0, oo) for q = 1,2,... . The q-norm of f denoted by \\f\\ q is 
defined as 

\\f\\' = (£m\'*y (2-2i) 

It is known that L q [ 0, oo) are complete normed linear spaces (Banach spaces) 
with respect to the g-norms. 

L q spaces can be extended further in the following way: 

Definition 2.1.8 ( L qe spaces, scalar case) 

For q = 1,2,... the signal space L qe consists of the functions f : Rj i— > R, 
which are Lebesgue-measurable and fr G L q for all T, 0 < T < oo. 

Note that the L qe spaces are not normed spaces. 

It is easy to see that L q C L qe . For this, consider a function / G L q . 
Then for any 0 < T < oo J 0 °° \fr(t)\ q dt < oo and therefore / G L qe . For the 
opposite direction, consider the signal g(t) = ^ and q = 1. It’s clear that 

for T < oo, / q T \g(t)\dt = ln(T + 1) — ln(l), but the L\ norm of g is not finite 
since linq^oc ln(t) = oo. Therefore g G Li e but g ^ L\. 

For the treatment of multi-input-multi-output systems, we define L q spaces, 
g-norms and L qe spaces for vector-valued signals, too. For this, consider a 
finite dimensional normed linear space v equipped with a norm || • ||„. 
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Definition 2.1.9 ( L q spaces, vector case) 

For q = 1,2, .. . the signal space L q (y) contains the functions f : Rq~ i— > v, 
which are Lehesgue-measurable and satisfy 

||/(i)||*di<oo (2.22) 




Definition 2.1.10 (q-norm, vector case) 

Let f G L q (y) for q = 1,2,... . The q-norm of f denoted by \\f\\ q is defined 
as 



ll/ll. 




wmwidt 



(2.23) 



Definition 2.1.11 ( L qe spaces, vector case) 

For q = 1,2,... the signal space L qe {v) consists of the functions f : Rq~ i— > v, 
which are Lebesgue-measurable and fr G L q (v) for all T, 0 < T < oo. 

Special Cases. Two important special cases for the (/-norms are given below 
(compare with Subsection A. 1.2). 

1. q = 2 
For / e L 2 




which can be associated with the inner product 

nOO 

</,/)=/ fm 

Jo 

Similarly, in the case of / £ L 2 (y) 

2. q = oo 
For / G Loo 



ll/lloo = sup \f(t)\ 

and for / G L^v) 

ll/lloo = sup \\f(t)\\ u 
tens/ 



(2.25) 



(2.26) 



(2.27) 



(2.28) 
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Example 2.1.4 (Signal spaces and their relations) 



Besides the L q - spaces, we can define many other signal spaces. A 
few examples are given below. 

T{T) vector space: let V be the set of functions mapping from 
a set T to the set of real or complex numbers, where the 
operations are defined point-wise, i.e. for x,y £ V and a £ K 

(x + y)(t) = x(t) + y(t), VteT 
( ax)(t ) = a ■ x(t), Vi € T 

The following vector spaces are the subspaces of T{T)\ 

B(T) vector space: B(T) is the set of bounded functions mapping 
from T to the set of real or complex numbers. 

C([a,b]) vector space: C([a,b]) is the set of functions which are 
continuous on the closed interval [a, b] . 

C^ k \[a,b]) vector space: let k € N, k > 1. The set of functions 
which are k times continuously differentiable on the interval 
[a,b\ is a vector space and is denoted by C^' 1 ([a,b]). At the 
endpoints of the interval a and b , the left and right derivatives 
of the functions are considered respectively. 

It is clear that the following relations hold in the above examples 
in the case when T = [a, b]: 

C (fc) [a,6] C C[a, b\ C B([a,b}) C F([a,b}) (2.29) 



2.2 Systems 

A system can be defined as a physical or logical device that performs an 
operation on a signal. Therefore we can say that systems process input signals 
to produce output signals. 

A system is a set of objects linked by different interactions and rela- 
tionships. The elements and boundaries of a system are determined by the 
interactions and mutual relationships, that are taken into consideration. 

The nature and outcome of the interactions in physical systems is gov- 
erned by certain laws. These laws can be used as a priori information in 
further examinations. The information about the system should be used in a 
well-defined form. 

A special group of information with major importance is the one that gives 
the current state of the system. The state of a system is the collection of all 
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Figure 2.3. System mapping the elements of the input signal space to the output 
signal space 



the information that describes the relations between the different interactions 
of the system at a given time instant (compare with Section 3.1 later). Two 
important kinds of information must be known in order to determine the 
state of the system: firstly, the structure of the system and secondly, the 
parameters of the system. A system can be described structurally by defining 
the system topology, the rules of interconnection of the elements and the 
functional descriptions of the elements (constitutive relations). 

Based on the above, a system can be considered as an abstract operator 
mapping from the input signal space to the output signal space (see Figure 
2.3). The notation of this is 

y = s[u], ueU, y ey (2.30) 

where S is the system operator, u is the input, y is the output, and U and y 
denote the input and output signal spaces respectively. 

2.2.1 Classification of Systems: Important System Properties 

Causality. The “present” in a causal system does not depend on the “fu- 
ture” but only on the past. This applies for every signal that belongs to the 
system and to the system operator S as well. 

Definition 2.2.1 (Causal system) 

A system is called causal if y(t) does not depend on u(t + t), Vt > 0,r > 0. 

Physical systems where time is the independent variable are causal systems. 
However, there are some systems that are not causal, e.g. 

• some optical systems where the independent variables are the space coor- 
dinates, 

• many off-line signal processing filters when the whole signal to be processed 
is previously recorded. 

Linearity. A property of special interest is linearity. 

Definition 2.2.2 (Linear system) 

A system S is called linear if it responds to a linear combination of its possible 
input functions with the same linear combination of the corresponding output 
functions. Thus for the linear system we note that: 





2.2 Systems 
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S[ci«i + C2U2] = ciS[ui] + c 2 S[w 2 ] 



(2.31) 



with ci,c 2 G R, ui,v,2 G U, yi,y2 G y and S[«i] = yi, S[u 2 ] = y 2 . 



Continuous Time and Discrete Time Systems. We may classify sys- 
tems according to the time variable t G T we apply to their description 
(see Subsection 2.1.2 for the definition of continuous and discrete time 
signals). There are continuous time systems where time is an open inter- 
val of the real line (T C R). Discrete time systems have an ordered set 
T = {• • • ,to,t\,t 2 ,- • • } as their time variable set. 

SISO and MIMO Systems. Here the classification is determined by the 
number of input and output variables. The input and output of a single 
input-single output (SISO) system is a scalar value at each time instant, 
while multi input-multi output (MIMO) systems process and produce vector- 
valued signals. 

Time-invariant and Time-varying Systems. The second interesting 
class of systems are time-invariant systems. A system S is time-invariant if 
its response to a given input is invariant under time shifting. Loosely speak- 
ing, time-invariant systems do not change their system properties in time. 
If we were to repeat an experiment under the same circumstances at some 
later time we get the same response as originally observed. This situation is 
depicted in Figure 2.4 below. 



u(t) 



u(r) 



u(t+At) 




Figure 2 . 4 . The notion of time invariance 



The system parameters of a time-invariant system are constants, i.e. they 
do not depend on time. 

We can define the notion of time invariance in a rigorous mathematical 
way using the shift operator defined in Equation (2.8). 
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Definition 2.2.3 (Time-invariant system) 

A system is called time-invariant if its system operator commutes with the 
time shift operator, i.e. 

T a o S = S o T 0 , VoGR. (2.32) 

2.2.2 Input output Stability: £ q -stability and i q -gain 

As we will see later in Chapter 7, it is of interest from the viewpoint of 
stability how a system operator changes the norm of the input signals. This 
property is expressed in the Testability and L q -gain of a system. 

For the following definitions, assume that IA and y are finite dimensional 
linear spaces of the input and output signals respectively, and S is a system 
operator mapping from L qe (U) to L qe (y). 

Definition 2.2.4 (X q -stability) 

S is called L q -stable if 

u G L q (U) => G(u) G L q (y) (2.33) 

Definition 2.2.5 (Finite T q -gain) 

S is said to have finite L q -gain if there exist finite constants y q and b q such 
that 

IK s M)t||(j < AqWurWq + b q , VT >0, Vw G L qe (U) (2.34) 

It is said that S has finite L q -gain with zero bias if b q can be zero in (2.3f). 

Definition 2.2.6 (£ q -gain) 

Let S have finite L q -gain. The L q -gain of S is defined as 

7 q (S) = inf{ 7 q 1 3b q such that (2.34) holds} (2.35) 



2.3 Summary 

Systems are described as abstract operators acting on signal spaces in this 
basic introductory chapter. The definition, classification and basic operations 
on both signals and systems are summarized, which will be extensively used 
throughout the whole book. 



2.4 Questions and Exercises 

Exercise 2.4.1. Give examples of signals of special importance. What is the 
relationship between the unit impulse and the unit step signal? 




2.4 Questions and Exercises 
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Exercise 2.4.2. What are the operations that are defined on signals? Char- 
acterize the elementary- and integral-type operations. Compute the convolu- 
tion of an arbitrary signal 

x : Rj i— > R 

with the shifted Dirac-<5 function S T which has its singular point at t = r. 

Exercise 2.4.3. Give the most important system classes. Define the class of 
continuous time linear time- invariant (LTI) systems. 

Exercise 2.4.4. Give the definitions of L q and L qe spaces and their underly- 
ing norms both in the scalar and vector case. Compare your definitions with 
the special cases of signal norms in Section A. 1.2 in the Appendix. 

Exercise 2.4.5. Consider the following signal: 

/ : R+ i— > R, f(t) = exp(— t 2 ), t> 0 

1. Show that / £ Li and / € L^. 

2. Calculate the L\ and L ^ norm of /. 

Exercise 2.4.6. The following two-dimensional signal is given: 

g : Rj ^ R 2 , f(t ) = 

Is g G L 2 1 
Is g € L 2e l 

Let || • || v be the normal Euclidean norm on R 2 . Calculate || || ^ for 
t > 0 and Hsu*,. 

Exercise 2.4.7. Calculate the convolution of /i and f 2 in Exercise 2.4.6 and 
check the convolution theorem for the Laplace transform of /i and f 2 . 



1 . 

2 . 

3. 



fl(t) 




-1 


h{t) 




3 • exp(— 2 1) 




3. State-space Models 



State-space models are the natural form of system models for a process engi- 
neer. The reason for this is that process engineering models originating from 
first engineering principles can be transformed into state-space form in the 
majority of practically important cases [32]. As a consequence, state variables 
in a process system model possess a clear engineering meaning - they are the 
canonical set of conserved extensive quantities in the process system. 



Throughout the book we restrict ourselves to the class of finite 
dimensional systems, that is, to systems with finite dimensional 
state variables. 

In process systems engineering terminology, such systems are as- 
sumed to consist of a finite number of perfectly stirred (or mixed) 
balance volumes and are called lumped systems [32]. 



This chapter introduces the fundamentals and basic notions of state-space 
representations and the most important classes of state-space models in the 
following sections: 

• Basic notions 

The concept of state is introduced. 

• Linear time-invariant state-space models 

A classical well-known state-space model class for which closed analytical 
solutions exist for most of the analysis and control problems [9] , [39] . 

• Linear time-varying and linear parameter-varying systems 

Special system classes which are relatively easy-to-handle extensions of 
the classical LTI case but are capable of describing some of the essentially 
nonlinear system classes. 

• Nonlinear concentrated parameter state-space models 

The input-affine form [37] is the system class this book deals with. As we 
shall see later in Chapter 4, majority of the lumped parameter index-1 
process models can be written in this form. 
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3.1 Basic Notions of State-space Representation 

State-space models rely on the general concept of state. If we describe a 
system as an operator mapping from the space of inputs to the space of 
outputs (see Section 2.2 for details), then we may need the entire input- 
output history of the system together with the planned input in order to 
compute future output values. This is in good agreement with the abstract, 
operator-based description of a system that is presented in Chapter 2. 

Alternatively, we may use new information (which is called the state of 
the system at to) that contains all past information on the system up to time 
to including the initial conditions for the outputs and its derivatives as well 
as the past input history. Then, to compute y(t) for t > to (all future values) 
we only need u(t), t > to and the state x{t) at t = to- 

The Concept of State. We may construct a signal, which is a time- 
dependent function, from the values of the state x[t) at any given time t, 
which is called the state signal x. Similarly to the input and output signals, 
we abbreviate the state signal simply to “state” . 



A description that uses the state signal is called a state-space de- 
scription or state-space model. 



State-space models for lumped (concentrated-parameter) systems consist 
of two sets of equations: 

1. State equations, which describe the evolution of the states as a function 
of the input and state variables, being a set of time-dependent ordinary 
differential equations. 

2. Output equations, which relate the value of the output signals to the state 
and the input signals, being algebraic equations. 

We recall that any kind of system model is in fact a realization of the abstract 
system operator S (see Chapter 2). Note that a realization of an operator 
mapping from a space U to y is obtained if one fixes a basis and there- 
fore a coordinate system in IA and y , and describes the mapping in these 
coordinates. 

It is important to note that only a finite number of state equations and 
the same number of state variables are needed to describe lumped systems, 
therefore they are called finite dimensional systems. This corresponds to the 
fact that there exists a finite dimensional basis in both the input space U and 
the output space y in this case. 
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3.2 Finite Dimensional Linear Time-invariant (LTI) 
Systems 

The most simple and yet important system class is the class of finite di- 
mensional linear time-invariant systems (abbreviated as FDLTI, or simply 
LTI systems). These systems and the analysis and control techniques based 
thereon are the subject of standard introductory courses on systems and 
control based on a state-space approach. The majority of the well-known 
and popular analysis and control techniques, such as controllability and ob- 
servability analysis, Kalman filtering or LQR (Linear Quadratic Regulator) 
theory, were developed and investigated for such systems and later on have 
been extended to more complicated system classes. 

Therefore, the LTI case will be used as a reference case throughout the 
book. Most of the new techniques and approaches will build on these used 
for LTI systems. 



3.2.1 The General Form of State-space Models 

For continuous time LTI systems the general form of state-space models is as 
follows: 

x(t) = Ax(t) + Bu(t) ( state equation) 

y(t) = Cx(t) + Du(t) ( output equation) 

with given initial condition x(to) = a;(0) and 

x(t) G R n , y(t) G R p , u(t) G R r 

being the state, output and input vectors of finite dimensional spaces and 

A G R nxr \ B G K" xr , C G R pxn , D G M pxr 

being matrices with constant (time-independent) elements. 

It is important to note the above state-space model applies also for MIMO 
systems when p > 1, r > 1. 



Most often we suppress t denoting the time dependence from the 
state, input and output signals and write simply x instead of x(t). 

Definition 3.2.1 (LTI state-space representation) 

The state-space representation (SSR) of LTI systems is the quadruplet of 
constant matrices (A, B,C, D) in Equation (3.1). The dimension of an SSR 
is the dimension of the state vector: dim x(t) = n. The state-space X is the 
set of all states: 



x(t) G X , dim X = n 
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Example 3.2.1 (LTI state-space model equation) 



Let us consider the following state-space model: 





v c U A 


UA 




riv o i 

Vc U 

0 

L u v h J 


X = 


V c CpcPcVc 

UA 


CPcPcVc 

v h UA 


X + 




cphphVh 


Vh cphPhVh _ 





y = x (3.3) 

with x, u, y £ 1Z 2 being two-dimensional vectors. If all the model 
parameters 



Vq , bci U, A, Cp c , p c , V}i, Vh, Cphi Ph 

are constants, then the above model is indeed linear and time- 
invariant, with the state equation (3.2) and output equation (3.3) 
and with the special output matrices ( C = I, D = 0 ). 

Note that the above LTI state-space model describes a heat ex- 
changer cell, the process system description of which is introduced 
in detail later in Subsection 4.4.2. 



3.2.2 Linear Transformation of States 

State-space models are not unique: if we have a state-space representation 
{A, B , C, D) for an LTI system, then we can easily find infinitely many other 
ones with the same dimension. 

Definition 3.2.2 (Equivalent state-space models) 

Two state-space representations are equivalent if they have the same input- 
output description. 

Equivalent state-space models of LTI systems can be generated by applying 
coordinate transformation on the state-space. Transforming the coordinates 
in the state-space is often very useful in order to highlight some properties of 
interest {e.g. reachability, observability, etc.), or to show how certain control 
problems can be solved. 

In the case of LTI state-space models, equivalent state-space representa- 
tions can be obtained by linear coordinate transformation, which relates two 
possible equivalent state-space models 

x(t) = Ax(t) + Bu{t), x(t) = Ax(t) + Bu{t) 
y{t) = Cx(t) + Du{t), y(t) = Cx(t) + Du(t) 

related by the transformation 



T e R” xn , det T/0 
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i.e. 

x = Tx => x = T~ x x (3.5) 

Observe that we do not transform the input and output signals because we 
want to preserve the input-output behavior of the state representations to 
have equivalent state-space models. 

If we transform the first set of state equations in Equation (3.4) using the 
transformation matrix T, we get 

dim X = dim X = n (3-6) 

and 

T~ x x = AT _1 x + Bu 

so finally 

W=TAT~ 1 x + TBu, y = CT~ 1 x + Du (3.7) 

In this way, we can define infinitely many state variables for the same 
system, and the realization matrices are related by 

A = TAT -1 , B = TB , C = CT" 1 , D = D (3.8) 

3.2.3 Special Realization Forms of LTI Systems 

Realizations of special forms play an important role in investigating the dy- 
namic properties of an LTI system. 

Diagonal Form Realization. Diagonal form realization is characterized by 
a diagonal state matrix A that plays a role in analyzing asymptotic stability. 
It is important to note that there are systems which cannot be transformed 
into diagonal forms (it is known from linear algebra that the necessary and 
sufficient condition for diagonalizing an nx n quadratic matrix is that it has 
n linearly independent eigenvectors). 

Definition 3.2.3 (Diagonal form realization of LTI systems) 

A diagonal form realization is a realization with the matrices ( A , B, C) in the 
following special form: 





Ai . . 


. 0 ' 




■&r 


A = 


0 . . 


• _ 


, B = 


. _ 


c = 


Cl . . 


Cn 1 







Note that the A * parameters present in the state matrix A of a diagonal 
form realization are the eigenvalues of the matrix and the poles of the system. 
A suitable transformation matrix T that brings a given realization (A, B, C) 
into its diagonal form can be constructed from the eigenvectors of the state 
matrix A. 
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Controller Form Realization. This realization plays a role in assessing the 
joint controllability and observability of an LTI system because it is always 
controllable. 

Definition 3.2.4 (Controller form realization of LTI systems) 

The controller form realization of an LTI system is given by the state-space 
model 

x(t) = A c x(t) + B c u{t) . . 

y(f) = C c x(t) 

with the matrices of the following special form: 



— «1 


-02 • • • 


~a n 


1 


0 ... 


0 


0 


0 . . 1 


0 



with the coefficients of the polynomial a(s) = s n + aiS n 1 
and 

r 

0 



B c = 



0 



C c = bi &2 • • • b n 



+ 0"n- I s + a n 



with the coefficients of the polynomial b(s) = biS n ~ 1 + ... + + b n where 

the above polynomials appear in the transfer function H (s) = ( see later 

in Definition 5.1.2 in Subsection 5.1.2). 



3.3 Linear Time-varying (LTV) Parameter Systems 

The simplest extension to the basic LTI case is the case of linear time- varying 
parameter systems (abbreviated as LTV systems) in which we allow the pa- 
rameters of an LTI system to be time-varying instead of being constant. In 
this way we can describe certain disturbances acting as parameters in the 
linear model if there is information on their time variation. In order to have 
a linear state-space model with time-varying parameters one needs to assume 
that the parameters enter into the model in a linear way. 

It is easy to see that an LTV system is still a linear system but it is no 
longer a time-invariant one. 
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In the case where the system parameters in a linear system vary with 
time we may generalize the state-space representation of LTI systems in the 
following way: 

x(t) = A(t)x(t) + B(t)u(t) (state equation) /'Qin'i 

y(t) = C(t)x(t ) + D(t)u(t ) ( output equation) 

with the state, input and output vectors x, u and y and with the time- 
dependent realization matrices (A(t), B(t),C(t), D(t)). 

It is important to note that the nice properties of LTI systems are partially 
lost or at least valid only locally for LTV systems. 



Example 3.3.1 (LTV state-space model equation) 



One can obtain an LTV state-space model from the simple LTI 
state-space model in Example 3.2.1 by assuming that the model 
parameters v c and v h vary with time. This assumption makes the 
state and input matrices time-varying in the form: 



A(t) = 



U c (t) 

vT - 012 

«21 



«12 

Vh(t) 



V h 



— 021 



, B(t) = 



Uc(t) 

Vc 

0 



0 

Vh (t) 

v h . 

(3.11) 



with the parameters ( 012 , 021 , V c , Vh ) being constants and with 
the special output matrices ( C = /, D — 0 ). 

Note that this is a realistic case for the modeled heat exchanger cell 
when we do not manipulate the flowrates v c and Vh but consider 
their naturally bounded slow variation with time. 



3.4 Linear Parameter-varying (LPV) Systems 

A further step in the generalization of LTI systems is the case where we 
consider the state-space matrices of an LTI system to be fixed functions 
of some vector of time- varying parameters 9(t) £ IV These systems are 
called linear parameter-varying systems (abbreviated as LPV systems) and 
are described by state-space equations of the form: 

x(t) = A(9(t))x(t) + B(9(t))u(t) (state equation) ('3 191 

y(t) = C(9(t))x(t) + D(9(t))u(t) (output equation) 

It is clearly seen that an LTV system is a special case of an LPV system 
when the vector of time- varying parameters equals time, i.e. 
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0{t) = t, l = 1 . 

From a practical point of view, LPV systems have at least two interesting 
interpretations: 

• they can be viewed as linear time-invariant (LTI) systems subject to time- 
varying parametric uncertainty 9(t), 

• they can be models of linear time-varying plants or models resulting from 
linearization of nonlinear plants along trajectories of the parameter 6. 

It is important to note that sometimes the whole parameter vector or some 
of its entries are chosen to be some of the system’s signals, such as some 
state variables being also time-varying quantities. With this approach we 
can describe a truly nonlinear system as an LPV system, and this may have 
advantages. 

Of particular interest will be those LPV systems in which the system 
matrices affinely depend on 9 , that is 

A{9) = Aq + 9iA\ + • • • + 9(A( 

B{9) = B 0 + 9 1 B 1 + --- + 9 e B e (3.13) 

C{0) =C 0 + 0i<7i + --- + 0 t C t 

D{6) = D 0 + 9 X D X + • • • + 9 t D t 

In addition, we usually assume that the underlying time-varying parameter 
9 varies in a convex matrix polytope 0 with corner-point vectors 

{u>i,u>2, - ■ - u>i G 

such that 

l i 

9(t) G 0 := Co{^i,U2,. ( ..|^} := {^ajUj : > 0, ^0^ = 1} (3.14) 

i - 1 j=l 

This way, we construct the parameter 9 as a convex linear combination of 
the vectors {u>i,u> 2 , ■ ■ ■ ,a>e}- This implies that every entry in the parameter 
vector is bounded. 

Again, special nonlinear systems, such as bilinear systems, can be de- 
scribed as affine LPV systems by considering some of the state and/or input 
signals as time- varying parameters. 




3.5 Nonlinear Systems 
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Example 3.4.1 (LPV state-space model equation) 



One can obtain n LPV state-space model from the simple LTI 
state-space model in Example 3.2.1 by assuming that the model 
parameter U , the heat transfer coefficient, varies with time. This 
assumption makes the state matrix A dependent on the time- 
varying parameter 9{t ) = U(t) in the form: 



A(U(t)) 



Vc _ AU(t) AU(t) 

Vc CPcpcVc C-PcPcVc 

AU(t) _vh _ AU(t) 

CphPhVh, V h CphphVh _ 



(3.15) 



The constant matrices Aq and Ai in the affine dependence equa- 
tion (3.13) 

A(U) = Aq + U A\ 

are as follows: 





v c 


0 ' 

Vh 




A 


A 


II 

o 


Vc 

0 


, Ai — 


CPcpcVc 

A 


C-Pcpc Vc 

A 




v h \ 




V-PhPhVh 


CPhPhVh 



assuming all the remaining parameters 

Vc, V c , A, Cp c , p c , Vh, Vh, Vph, Ph 
to be constants. 

The remaining three matrices in the state-space representation 
are constant matrices, that is 



B = 



yc o 

V u 
n li. 
u v h J 



(3.17) 



and the special output matrices are ( C = I, D = 0 ) . 

Note that this is a realistic case for the modeled heat exchanger cell 
when we consider the natural deterioration of the heat exchanger 
surface due to CaCC >3 formation. 



3.5 Nonlinear Systems 

Nonlinear finite dimensional systems represent a wide class of nonlinear sys- 
tems. Lumped process models derived from first engineering principles belong 
to this class. 

The general form of state-space models of finite dimensional nonlinear 
systems is: 
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x(t) = f(x(t), u(t)) (state equation) (3 18) 

y(t) = h(x(t),u(t)) (output equation) 

with the state, input and output vectors x, u and y and with the smooth 
nonlinear mappings 

/ : r x W R", h : R n xR r ^R p . 

3.5.1 The General Form of State-space Models for Input-affine 
Systems 

If the nonlinear functions / and h above are in a special form, the so-called 
input-affine form is obtained. 

Definition 3.5.1 (Input-affine nonlinear state-space models) 



x(t) = f(x(t)) + jyjLi 9i(x(t))ui(t) (state equation) , , 

y(t) = h(x(t)) (output equation ) ^ ’ 

with the same state, input and output vectors x, u and y as above, and with 
the smooth nonlinear mappings 

f : R n i-> gi : R” i-> R, h : R" h-> RP 

It is important to observe that the input signals enter into the input-affine 
nonlinear state-space model in a linear way, that is, the mapping / in the 
original general nonlinear state-space model (3.18) is linear with respect to 

u. 



3.5.2 Nonlinear Transformation of States 



Transforming the coordinates in the state-space is also useful in the nonlinear 
case, in order to investigate dynamic properties of interest (e.g. reachability, 
observability, etc.) or to solve certain control problems. Of course, nonlin- 
ear coordinate transformations are usually applied to nonlinear state-space 
models. 

Definition 3.5.2 (Nonlinear coordinate transformation) 

A nonlinear change of coordinates is written as 

z = $(x) (3.20) 



where <P represents an R n -valued function of n variables, i.e. 





(j>l(x) 




f>l(Xl, ■ . 


• 7 %n) 


<P(x) = 


<h(x) 


= 


4>2(Xl, ■ ■ 


• 7 %n) 




_4>n(x)_ 




_ 0n(*£ 1 5 • • • t _ 



with the following properties: 



(3.21) 




3.5 Nonlinear Systems 
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1. <P is invertible, i.e. there exists a function <P~ 1 such that ( P^ 1 (<P(x)) = x 
for all x inW 1 . 

2. <P and d>~ 1 are both smooth mappings, i.e. they have continuous partial 
derivatives of any order. 

A transformation of this type is called a global diffeomorplrism on R n . 



Example 3.5.1 (A simple nonlinear state transformation) 



Consider a simple nonlinear vector-vector function / 



f(xi,x 2 ) = f(x) = J J 



and let the function <P generating the coordinate transformation 
be given as 



z = <h{x) 



v^i 

yfxf 



which is invertible on the domain x\ > 0, x 2 > 0. Its inverse 
function is: 



x = <P 1 (z) 




Therefore the original function / in the transformed coordinate 
system will be: 



f(z) = 



4 i 4 

zf + 

4 + 4 



Sometimes, a transformation having both of these properties and being de- 
fined for all x is difficult to find. Thus, in most cases, one looks rather at 
transformations defined only in a neighborhood of a given point the existence 
of which is guaranteed by the inverse function theorem. A transformation of 
this type is called a local diffeomorphism. In order to check whether a given 
transformation is a local diffeomorphism or not, the following result is very 
useful. 

Suppose <P is a smooth function defined on some subset U of K™ . Suppose 
the Jacobian matrix of <P is nonsingular at a point x — x°, then, on a suitable 
open subset U° of U, containing x°, defines a local diffeomorphism. 

3.5.3 Bilinear State-space Models 

An important special case of general nonlinear state-space models (3.18) are 
the so-called bilinear state-space models. In these models, the nonlinear func- 
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tions f and h become 

n m 

xe{t) = hejnjit) 

j=i j= i 

m n 
3 = 1 i=l 

i = 1, . . . , n ( state equations) 

n 

Vk(t) = J2c { °Jxj(t) (3.22) 

i= i 

A; = 1, . . . ,p (output equation ) 

with the same state, input and output vectors x, u and y as above. 

It is easy to see that bilinear state-space models are special cases of the 
input-affine models, because the input signal enters into the model in a linear 
way. 

We shall see later in Section 4.3.1 that a wide class of process systems 
models belong to the class of bilinear state-space models. 



Example 3.5.2 (Bilinear state-space model equation) 

Let us consider a modified version of the simple state-space model 
in Equation 3.2 by changing the input variables to have 

u=[v c , v h } T 

and considering the elements of the old input vector 

no = [ uoi, U02 ] T = [ T c i n, T hIN ] T 

to be constants. The following bilinear state-space model is ob- 
tained: 
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U = x 

with x, u, y € 1Z 2 being two-dimensional vectors. 
If all the model parameters 



(3.23) 

(3.24) 



T c in , V c , U, A, cp c , pc, ThiN j Vh, cph, Ph 



are constants, then the above model is indeed bilinear and time- 
invariant, with the state equation (3.23), with a trivial output 
equation and with the special model matrices: 





UA 


UA 




r t c in 


0 

ThiN 


A<® = 


CPcpc V c 
UA 


CPc^cVc 


, B (0) = 


i 




CphPhVh 


CPhPhVh 




Vh 



[-£°1 


, b {2) = 


'0 0 
r\ 1 


0 °_ 




L°-vd 



B {1) = 

All the remaining matrices are zero matrices. 



C (0) = I 



3.6 Summary 

The state-space representations of the most important finite dimensional 
(lumped) system classes are briefly reviewed and described in this chapter. 
They will be used in the rest of the book. 

The linear time-invariant (LTI) state-space model is introduced first, since 
it serves as a basic case for all extensions towards the nonlinear state-space 
representation forms. The linear time-varying parameter (LTV) and linear 
parameter- varying (LPV) systems are seen as intermediate cases between 
the basic reference LTI and the general nonlinear cases. 

The general and input-affine state-space models, introduced last, are the 
basis of all the nonlinear analysis and control techniques described in this 
book, are also introduced here. 

The linear and nonlinear coordinate transformations, which generate 
classes of equivalent linear and nonlinear state-space models, complement 
the chapter. 
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3.7 Questions and Exercises 

Exercise 3.7.1. Show that (3.1) is indeed a linear and time-invariant model. 

Exercise 3.7.2. Show that an LTV system is a linear system, but it is not 
a time-invariant one. 

Exercise 3.7.3. Prove that the state-space representations given by the ma- 
trices 

1. A , B, C 

2. A — TAT B = TB, C = CT 
give the same transfer function. 

Exercise 3.7.4. Show that the quantities 

CA l B, i = 0,1,... 



called Markov parameters of an LTI system with state-space representation 
matrices (A, B , C) are invariant under linear state transformations. 

Exercise 3.7.5. Consider the following functions and points in the state- 
space 

1. f{x) = x 2 + 3, Xi = 0, x 2 = 3 

2. f[x) = (x — 4) 3 , x\ = 4, X 2 = 0 

Is there any open neighborhood of X\ and X 2 where / is invertible? 
Exercise 3.7.6. The following vector-field is given: 

'<*'»>= [(t+2)"] (3 - 25) 

Is there any open and dense subset of R 2 where / can be inverted? If yes, 
give such a set and calculate the corresponding inverse function. 

Exercise 3.7.7. Consider a simple nonlinear vector-vector function / 

f(xi,x 2 ) = f{x) = X \^ X \ 

•*'2 _ 



and let the function <P generating the nonlinear coordinate transformation be 



given as 



2 = 4 ^(x ) 



a, resin X\ 
arcsin x 2 



Apply the coordinate transformation to the function / above and give its 
form in the transformed coordinates. 
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= x 



1/2 3/2 



X 0 — 



X\x\ 



1/ 2 



Exercise 3.7.8. Consider the state equation of a simple two-dimensional 
quasi-polynomial system 

dx i 
dt 

= 3x\x^ 2 — 2x\x2 

Apply the following quasi-polynomial nonlinear coordinate transformation 



u 1 



z = <P(x) = 



3 1/3 
X\X2 

X 1 / 4 X 2 



to the system. 

Is the resulting system model quasi-polynomial again? Why? 
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Dynamic process models and their properties form the background of any pro- 
cess control activity including model analysis, model parameter and structure 
estimation, diagnosis, regulation or optimal control. Therefore this chapter is 
entirely devoted to dynamic process modeling for control purposes: the con- 
struction and properties of lumped dynamic models. Process modeling is an 
important and independent area in itself within process systems engineering 
with good and available textbooks (see, e.g. [32] providing an overview and 
introduction to the key concepts, methods and procedures). This chapter is 
not intended to replace a process modeling textbook in a short form, but 
rather focuses on the particular characteristics of a dynamic lumped param- 
eter process model, which is seen as a finite dimensional system model given 
in its state-space model form. The chapter is broken down into the following 
sections. 

• Process modeling for control 

We start with a brief overview of the way process models are generally con- 
structed together with a description of the ingredients of lumped dynamic 
process models. 

• State-space models of process systems 

The special properties of finite dimensional state-space models derived from 
conservation balances are then described together with their system vari- 
ables. A decomposition of the state equations driven by the mechanisms 
taking place in the process system is also given. 

• Special nonlinear process systems 

A separate section is devoted to special finite dimensional nonlinear pro- 
cess systems, including bilinear systems with no source term in their con- 
servation balance equations, and system models in differential-algebraic 
equation (DAE) form. 

• Examples 

Finally three sets of simple process models giving rise to finite dimensional 
nonlinear state-space models are given in separate sections: heat exchanger 
models, continuously stirred tank reactor (CSTR) models and a model of 
a gas turbine. These models will be used later in the book for illustrating 
nonlinear analysis and control techniques. 
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4.1 Process Modeling for Control Purposes 

A modeling task is specified by giving the description of the process system 
to be modeled together with the modeling goal, i.e. the intended use of the 
model. The modeling goal largely determines the model, its variables, spa- 
tial and time characteristics, as well as its resolution or level of detail and 
precision. Process control as a modeling goal does not require very accurate 
models, we only aim at about 5 percent precision in values, but process con- 
trol requires dynamic models that capture the time characteristics (dead time 
and time constants) of the model well. Moreover, we usually use lumped pa- 
rameter dynamic process models for control purposes because the resulting 
finite dimensional system models are much easier to handle. Therefore we 
usually use some kind of lumping, most often the so-called “method of lines” 
procedure (see, e.g. [32]) to obtain a lumped parameter approximation from 
a distributed parameter system model. 

Definition 4.1.1 (Balance volume) 

Parts of a lumped process system which 

• contain only one phase or pseudo-phase, 

• can be assumed to be perfectly mixed, 

will be termed balance volumes or lumps. 

Balance volumes are the elementary dynamic units of a lumped process sys- 
tem for which dynamic balances can be constructed and assumptions can be 
made. 

4.1.1 General Modeling Assumptions 

We restrict ourselves to the following class of systems and system models 
throughout the book: 

1. Only lumped process models that result in a model in ordinary 
differential-algebraic equation (DAE) form are considered. 

2. We only treat initial value problems. 

3. All physical properties in each phase are assumed to be func- 
tions of the thermodynamic state variables (temperature, 
pressure and compositions) of that phase only. 



These general assumptions ensure that we always have an index 1 model 
with the possibility of substituting the algebraic constitutive equations into 
the differential ones. This is always possible if we choose the free variables 
and parameters of the model, the so-called specification, in a proper way. 

In order to get relatively simple models where the algebraic equations 
can all be substituted into the differential ones, we use the following two 
additional general assumptions in the majority of our examples: 
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4. Constant pressure is assumed in the whole process system. 

5. All physical properties in each phase are assumed to be con- 
stant. 



Note that the last general assumption overrides assumption 3 by stating 
that all physical properties do not depend on any other variable, but that 
they are constant. 

4.1.2 The Principal Mechanisms in Process Systems 

Mechanisms in a process system describe different means of material or en- 
ergy transport or transformation. Therefore we encounter a great variety of 
possible mechanisms in a process system. In order to complete the steps of 
constructing a mathematical model of a process system (see Section 4.1.4 
for more details) we need to analyze the modeling problem statement and 
decide which mechanisms should be included in the model. For lumped pa- 
rameter process systems these mechanisms include, but are not limited to, 
the following: 

1. Convection: 

A material and energy transport mechanism in which the conserved 
extensive quantities (overall mass, component masses and energy) are 
carried by the transport of the overall mass, i.e. by flows. The inflows 
and outflows of the balance volumes can be regarded as convection in 
lumped process systems. 

2. Transfer: 

A component mass or energy transport mechanism between two phases 
in contact when there are no convective flows involved. The driving force 
for transfer is the difference between the thermodynamical state variables 
(temperature, pressure and compositions) in the two phases. 

3. Chemical reaction: 

A component mass transformation mechanism, which generates the 
products of a chemical reaction from the reactants. It usually also in- 
volves enthalpy (energy) transformation: generation or consumption. 

4. Phase changes: 

A phase transformation mechanism, such as evaporation, condensation, 
melting, boiling, crystallization, etc. where the chemical composition re- 
mains unchanged. It also involves enthalpy (energy) transformation. 

A basic property of the mechanisms of a process system is that they are 
assumed to be strictly additive , that is, they give rise to additive terms in the 
conservation balance equations of a process system. 
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4.1.3 The Basic Ingredients of Lumped Process Models 

The equations of a particular model satisfying the general modeling assump- 
tions” in Section 4.1.1 are of two types: 

• differential equations (explicit first-order nonlinear ODEs with initial con- 
ditions), 

• algebraic equations. 

The differential equations originate from conservation balances, therefore 
they can be termed conservation balance equations. The algebraic equations 
are usually of mixed origin: they will be called constitutive equations. Along 
with the above equations we have other model elements associated with them 
such as: 

• modeling assumptions, 

• variables and parameters, 

• initial conditions, 

• data (specification) of model parameters and constants. 

Variables are time-varying or time-dependent quantities in process model 
equations. They are also called signals in system theoretical terminology. A 
variable x is called differential if its time derivative (^) is explicitly present 
in the DAE model. A variable is termed algebraic if it is not differential. 

Parameters, on the other hand, are quantities which are either constant 
or are regarded to be constant in a particular process model. 



4.1.4 The Model Construction Procedure 

In order to construct a process model satisfying a given modeling goal, the 
problem statement of the modeling, that is, the process system description 
together with the goal, should be carefully analyzed first to find the relevant 
mechanisms together with a suitable level of detail. These drive the construc- 
tion of the process model equations, which is carried out in steps forming the 
model construction procedure. Good modeling practice requires a systematic 
way of developing the model equations of a process system for a given purpose. 
Although this procedure is usually cyclic, in which one often returns back to 
a previous step, the systematic procedure can be regarded as a sequence of 
modeling steps as follows: 

Step 0. System and subsystem boundary and balance volume definitions 
The outcome of this step is the set of balance volumes for mass, energy and 
momentum. These are the conserved extensive quantities normally considered 
in process systems. Moreover, the number of components is also fixed for each 
mass balance volume. 
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Step 1. Establish the balance equations 

Here we set up conservation balances for mass, energy and momentum for 
each balance volume. 

Step 2. Transfer and reaction rate specifications 

The transfer rate expressions between different balance volumes in the conser- 
vation balances are specified here usually as functions of intensive quantities. 
The reaction rates within balance volumes are also specified. 

Step 3. Property relation specifications 

Mostly algebraic relationships expressing thermodynamic knowledge, such 
as equations of state and the dependence of physico-chemical properties on 
thermodynamic state variables, are considered here. 

Step j. Balance volume relation specifications 

Equipment with a fixed physical volume is often divided into several balance 
volumes if multiple phases are present. A balance volume relation describes 
a relation between balance volumes and physical volumes. 

Step 5. Equipment and control constraint specifications 
There is inevitably the need to define constraints on process systems. These 
are typically in the form of equipment-operating constraints (in terms of tem- 
peratures, pressures, etc.) and in terms of control constraints, which define 
relations between manipulated and controlled variables in the system. 

Step 6. Selection of design variables 

The selection of design variables is highly dependent on the application area 
or problem and is not necessarily process - specific. The process itself only 
provides constraints on which variables are potentially relevant. The selection 
of design variables may greatly influence the mathematical properties of the 
model equations, such as the differential index. 

4.1.5 Conserved Extensive and Intensive Potential Variables 

Any variable characterizing a process system can be classified as either exten- 
sive or intensive depending on how this variable behaves when joining two 
process systems together. 

Definition 4.1.2 (Extensive variable) 

A variable which is proportional to the overall mass of the system, that is, 
which is strictly additive when joining two process systems, is termed an 
extensive variable. 

Dictated by the basic principles of thermodynamics, there is a canonical set 
of extensive variables which is necessary and sufficient to describe uniquely a 
single phase process system. This set includes overall mass, component masses 
and energy for a perfectly stirred (lumped) balance volume. It is important 
to note that these extensive variables are conserved, therefore conservation 
balances can be constructed for each of them (see later in Section 4.1.6). 
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Potentials or intensive quantities are related to any of the above extensive 
conserved quantities. 

Definition 4.1.3 (Intensive variable (potential)) 

Intensive variable (or potential) difference (both in space and between phases 
in mutual contact) causes transport, (transfer or diffusion depending on the 
circumstances) of the related extensive quantity. 

The following intensive variable (potential) - extensive variable pairs are 
normally considered in process systems: 

• temperature to internal energy or enthalpy, 

• chemical potential, or simply concentration, to mass of a component, 

• pressure to overall mass (not relevant for our case due to the constant 
pressure general assumption in Section 4.1.1). 



4.1.6 Conservation Balances 



Conservation balances can be set up for any conserved extensive variable 
in any balance volume of a process system. Recall that overall mass, compo- 
nent masses and internal energy form the canonical set of conserved extensive 
quantities. If we consider an open balance volume with in- and outflows (con- 
vection), transport (an inter-plrase mechanism) and other intra-phase trans- 
formation mechanisms, the verbal form of a conservation balance equation is 
as follows: 

f net change in 1 _ f in- 1 f out- I f generation 

( ext. quantity J ( flows J ( flows J ( consumption 




Note that there is no source term for the overall mass balance because of the 
mass conservation principle. Chemical reaction appears in the generation- 
consumption term of the component mass and the energy balances, while 
phase transition gives rise to a generation-consumption term in the energy 
balance. Inter-plrase transfer also appears in the generation-consumption 
term of both the component mass and energy balance equations. There is 
no overall mass transfer between the phases because of the constant pressure 
assumption. 

The basic equation which drives all the other conservation balances is the 
overall mass balance of the perfectly stirred balance volume j: 



dm W 
dt 



,0) _ O') 

u out 



(4.2) 



where and v mt are the mass in- and outflow rates respectively. 



Under the above conditions the general form of a differential balance 
equation of a conserved extensive quantity (f for a perfectly stirred balance 
volume j takes the form: 
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dtfi) 

dt 



( i )^( i ) _ U) Ao) , \j> , u 

^in Tin "out^r out ' ^(p, transfer ' ^(p y 



U) 



„(j) 



(4.3) 



Observe that the overall mass balance (4.2) is a special case of the general 
balance equation (4.3) with 



q 



O') 

m,transfer 



= o, 



q 



0) 

m, source 



= o 



(4.4) 



Note that the conserved extensive quantity <j>^ of balance volume j can be 
any variable from the following set: 



(j> G {E, ( m k ,k = 1, . . .,K)} 



(4.5) 



where E is the energy, nik is the component mass of the k- th component, 
with K being the number of components in the balance volume. The related 
intensive variable (potential) is taken from the set: 

$e{T,(c k ,k = l,...,K)} (4.6) 



where T is the temperature and c^. is the concentration of the fc-th component. 



4.1.7 Constitutive Equations 

Some of the terms in the general conservation balance equations (4.3) above 
call for additional algebraic equations to complete the model in order to have 
it in a closed solvable form. These complementary algebraic equations are 
called constitutive equations. Constitutive equations describe 

• extensive— intensive relationships, 

• transfer rate equations for mass transfer and lreat/energy transfer, 

• reaction rates, 

• property relations: thermodynamical constraints and relations, such as the 
dependence of thermodynamical properties on the thermodynamical state 
variables (temperature, pressure and compositions), equilibrium relations 
and state equations, 

• balance volume relations: relationships between the defined mass and en- 
ergy balance volumes, 

• equipment and control constraints. 

Extensive— intensive Relationships. Recall that potentials, being inten- 
sive variables, are related to their extensive variable counterparts through 
algebraic equations. These involve physico-chemical properties, which may 
depend on other potentials or on the differential variables, because the ther- 
modynamical state variables, temperature, pressure and concentrations are 
intensive quantities. An example is the well-known intensive— extensive rela- 
tionship of the U-T pair 
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U = mcyT 



where U is the internal energy, m is the total mass, T is the temperature 
and Cy is the specific heat capacity (a physico-chemical property) of the 
material in a balance volume. Note that because of the above properties of the 
intensive quantities and their relation to the extensive conserved quantities, 
the potential form of the model equations is usually derived by additional 
assumptions on the physical properties. In the above example 

Cy = c v(T,P,(ci,i = 



but because of the “general modeling assumptions” in Section 4.1.1 
cy = const is assumed. 

Transfer Rate Equations. These are used to describe the algebraic form 
of the transfer term Q^ trans f er in the general balance equation (4.3). Dictated 
by the Onsager relationship from non-equilibrium thermodynamics, this term 
has the following general linear form: 

^transfer = transfer (* U) ~ ( 4 - 7 ) 



(i k) 

Here the transfer coefficients K<j,’ trans f er are generally assumed to be con- 
stants and the driving force for the transfer between balance volumes j and 
k is the difference of the potential variables and 



4.2 State-space Models of Process Systems 

The state-space model of a lumped process system obeying the “general mod- 
eling assumptions” in Section 4.1.1 can be obtained by substituting the al- 
gebraic constitutive equations into the conservation balance equations. This 
fact is used in this section to highlight the special structural properties which 
characterize a nonlinear state-space model derived from conservation balance 
equations. 



4.2.1 System Variables 

A possible state vector x for the nonlinear state-space model is: 

x=[(E^\{m ( i\k = l,...,K)) , j = l ,...,C] T (4.8) 

dim(i) = n = (K + 1) • C 

with K being the number of components and C being the number of balance 
volumes. Note that the linear relationship 
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K 

m ^ (4.9) 

fc= l 

enables us to choose the complete set of component masses to be present in 
the state vector. 

The potential input variables (including both manipulable input variables 
and disturbances) are also fixed by the state equations (4.3). They are the 
time-dependent variables (signals) appearing on the right-hand side of the 
equations, and not being state variables, that is 

u = [(u (j) ,^ ) u ( j) ), j = 1,... ,C] T (4.10) 

Note that we have formed a composite input vector from two sig- 

nals so that the corresponding term in the balance equation (4.3) has a ho- 
mogeneous form. Any external signal present in the source relations Q^\ ource 
should also be included in the set of potential input variables. 



4.2.2 State Equations in Input-affine Form 

In order to transform the general form of conservation balance equations 
into canonical nonlinear state equation form, the state and input variables 
above need to be centered using an arbitrary steady state as reference. Note 
that this step is not needed if there is no source term or if all sources are 
homogeneous functions. There can be process systems with no steady state at 
all, such as batch or fed-batclr processes. Their variables cannot be centered, 
therefore their conservation balance equations cannot be transformed into a 
nonlinear state-space model in input-affine form. 



For the reference input-state pair ( x*,u *) the left-hand sides of 
the balance equations (4-3) are zero. 

Definition 4.2.1 (Centered variable) 

A centered variable is then the difference between its actual and reference 
value, that is 

Tp = y-ip* 

The centered state variables and the centered input variables are then as 
follows: 

x = [(e ( j) , (m^\k = 1,. . ., AT)) , j = 1 ,... ,C] T , \x\ = n= {K+l)*C 

(4.11) 



u= [(uW,^ 1 ^)), j = 1,...,C] T 



(4.12) 
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With the centered state (4.11) and input vectors (4.12) the general form 
of lumped dynamic models of process systems can be transformed into the 
standard input-affine form of nonlinear concentrated parameter state-space 
equations: 

m 

X = /( x) + 'Y^g i {x)u u u G R m , /( 0) = 0 (4.13) 

i = 1 

where x = [x-{. . . . ,x n ] T are local coordinates of a state-space manifold M. 
It is important to note that the state equations of process systems are always 
in an input-affine form above, because of the structure of the general state 
equation (f-3), if the system possesses a steady state. 

4.2.3 Decomposition of the State Equations Driven by 
Mechanisms 

The state equations in a nonlinear input-affine state-space model of a process 
system are derived from the general conservation balance equation (4.3). 
This equation has four terms in its right-hand side, corresponding to the 
four principal mechanisms we take into account when constructing process 
models: 

• input convection (inflow term), 

• output convection (outflow term), 

• (inter-plrase) transfer, 

• sources including both generation and consumption. 

In addition, the concrete mathematical form of the state equations depends 
on the selection of the actual input variables from the set of potential ones. 
Let us assume that: 

1. The flow rates (and the conserved extensive quantities at the inlet) 
are the input variables (manipulable input variables or disturbances). 

2. There are no external sources to the system to be included in the set of 
potential input variables, that is 

Source = • • • , 4l x ) (4.14) 

where QffJ is a given nonlinear function. 

It can be shown that, under the above conditions, one can decompose the 
nonlinear vector-vector functions f(x) and g{x) in the nonlinear state equa- 
tion (4.13) into structurally different additive parts with clear engineering 
meaning: 

m 

X — -^transfer % H - ^ ^ NiXUi (4.15) 

i—1 
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The first term in the above equation originates from the transfer, the sec- 
ond from the sources, while the last two correspond to the output and in- 
put convection respectively. The coefficient matrices A tran sferi B conv and 
(TV ,;, i = 1 ,...,m) are constant matrices, with A trans f er depending on the 
non-negative transfer coefficients K$’fr ans f er Equation (4.7), while TV; is a 
matrix with non-negative elements that depends on the connections between 
the balance volumes. 

It is important to note that TV; is a matrix where only its i-th column is 
different from zero. More on the connection matrix TV; will follow in Section 
4.2.4. 

It is easy to see from relation (4.7) that the linear constant (i.e. time- 
invariant) state matrix A trans f er is always negative semi-definite and also 
has zero eigenvalues. Moreover, the nonlinear source function Q^(x) is of 
block diagonal form with the blocks joining the state variables belonging to 
the same balance volume. 



Thus, the decomposed state equation contains a linear state term 
for the transfer, a general nonlinear state term for the sources, a 
bilinear input term for the output, and a linear input term for the 
input convection respectively. 



4.2.4 Balance Volumes Coupled by Convection 

Until now we have only taken into account that the balance volumes are 
coupled by the transfer terms (4.7), giving rise to the linear constant (i.e. 
time-invariant) state matrix A trans f er . Now we consider the effect of convec- 
tive flows joining balance volumes to find the form of the input and output 
convection matrices (TV;,* = l,...,m) and B conv . In order to describe the 
general case let us assume that the outlet flow of the balance volume j is 
divided into parts and fed into other balance volumes, giving rise to the 
equation: 

C 

Y, a e ) = 1, i = ( 4 - 16 ) 

£—0 

where a.' 1 is the fraction of the total outlet flow of balance volume i 
that flows into balance volume j. The mass inflow of balance volume j then 
consists of the outflows from all the connected balance volumes, including 
the balance volume itself, together with a flow from the environment which 
is described as a pseudo-balance volume with index 0: 

v (A = Ya {i) v W i 

'bfi / j j u oui 

e=o 



j = o,...,c 



(4.17) 
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Finally we collect the ratios above into a convection matrix C conv as 
follows: 



C — 






„(i) 



(1)\ „,( 2 ) 



„( 2 ) 



AC ) 



-a-4 c) ) 



(4.18) 



Observe that only the ratios belonging to the internal (that is not environ- 
mental) flows are collected in the matrix above. It is important to note that 
because of Equation (4.16) the convection matrix C conv is a column conserva- 
tion matrix and therefore it is a stability matrix (see Section 7.4.2 in Chapter 

7 ). 

From theoretical and practical viewpoints there are two cases of special in- 
terest: 



• free output convection, 

• passive (controlled) mass convection. 

These are described below and will be used throughout the book. 

Free Mass Convection Network. The first special case of interest is when 
the output mass flow of any of the balance volumes is proportional to the 
overall mass in the balance volume, that is 

v out = > 0 (4.19) 



The inlet mass flow of the balance volume j can then be written as 



vW = 



t=i 



(0)„,(0) 



+ a) 'v, 



j = 0,.. m C 



(4.20) 



where af ] v^ t = 4jv is the mass inflow of the balance volume from the 
environment, that is, the real inflow. With the free convection equation above, 
the overall mass balance of the balance volume j (4.2) takes the following 
form: 

= + vfy, j = 0,...,C (4-21) 



Let us collect the overall mass and the real inlet mass flow of every balance 
volume into vectors M and Vjn respectively: 

M = [ m (1) . . . m (C) ] T , Vjjv = [ • • • 4w] T 

Equations (4.21) then can be written in the following matrix-vector form: 

—jjT = C conv KM + Vin (4.22) 

where K, = diag[nA’ \ j = 1, . . . ,C] is a diagonal matrix with positive ele- 
ments. 




4.3 Special Nonlinear Process Systems 



51 



Passive Mass Convection Network. We can generalize the above free 
convection case to obtain a convection network which is asymptotically stable, 
that is, passive in itself, as follows. Let us collect the mass in- and outflows 
of every balance volume into the vectors: 



*out — 



U out 



v iC) ] T 

• • u out\ 1 



Vin — f 



(i) 



■ • VI 



(C)lT 



in J 



and write Equation (4.17) as 



(f-'cony 4” / ) ^ out 4” 1' VjV 



(4.23) 



where I is the unit matrix. In order to make the overall mass subsystem 
stable, let us apply a full state feedback stabilizing controller (see Chapter 9) 
in the form of 



V out = /CM (4.24) 

with a positive definite square state feedback matrix /C. By substituting Equa- 
tions (4.23) and (4.24) into the overall mass balance equations in Equations 
(4.21), a linear time-invariant state equation results, which has exactly the 
same form as Equation (4.22). 

Definition 4.2.2 (Passive mass convection network) 

An overall mass subsystem with the linear time-invariant state equation 
(4-22) and with a positive definite square state feedback matrix 1C is called 
a passive mass convection network. 



4.3 Special Nonlinear Process Systems 

The previous section shows that the state-space model of lumped process 
systems indeed exhibits a number of special and potentially useful properties. 
This section is devoted to two interesting special cases within the class of 
lumped process systems, which are as follows: 

• lumped process systems with no source terms, resulting in state equations 
in bilinear form, 

• lumped process systems not obeying the “general modeling assumptions” , 
giving rise to non-standard DAE system models. 

4.3.1 Bilinear Process Systems 

We have seen in the previous section that lumped process models obeying 
the “general modeling assumptions” can be transformed into an input-affine 
nonlinear state-space model form. Moreover, a decomposition of the state 
equation of lumped process systems has been introduced in Section 4.2.3 in 
the form of Equation (4.15). There, it was assumed that the flow rates 
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(and the conserved extensive quantities at the inlet) were the input variables 
(manipulable input variables or disturbances). 

This decomposition shows that the input function g in the input-affine 
state equation x = f{x ) + g(x)u is always a linear function of the state 
vector x because of the properties of the convective terms from which it 
originates. The nonlinear state function f(x) is broken down into a linear 
term originating from transfer and a general nonlinear term caused by the 
sources (other generation and consumption terms, including chemical reac- 
tions, phase changes, etc.). These observations together result in the condi- 
tions for a lumped process system model to be in a bilinear form. 

Lumped process models with no source term and obeying the “gen- 
eral modeling assumptions” can be transformed into a bilinear 
state-space model form, assuming that the flow rates (and pos- 
sibly the conserved extensive quantities at the inlet) are the input 
variables (manipulable input variables or disturbances). 



4.3.2 Process Models in DAE Form 

In this subsection we temporarily relax the constant pressure and constant 
physico-chemical properties assumptions in the set of “general modeling as- 
sumptions” in Section 4.1.1 in order to investigate their effect on the set of 
model equations. It is shown below in the example of a simple evaporator 
that the presence of the state equation (think of the ideal gas equation as 
an example), together with the dependence of specific heat capacity on the 
temperature and pressure, results in a model where the algebraic constitutive 
equations cannot be substituted into the differential ones. This means that 
one cannot transform the lumped process model into a canonical nonlinear 
state-space model form. It remains inherently in its original DAE form. 



Example 4.3.1 (A simple evaporator model) 



Consider a simple single component phase equilibrium system 
where vapor and liquid phases are present [31]. This is shown 
in Figure 4.1. Vapor (denoted by subscript y) and liquid (l) are 
taken from the vessel, whilst energy is supplied via a heater. Inside 
the vessel we have two phases with respective hold-ups My , Ml 
and temperatures Ty, Tl- A feed (with mass flow rate F) enters 
the system. In this model representation, we consider two distinct 
balance volumes: one for vapor, the other for liquid. From this de- 
scription we can write the system equations in lumped parameter 
form, which describes the dynamic behavior: 
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1. Conservation balances 

Mass: 



dM v 

dt 



= E-V 



dM L 

dt 



= F- E-L 



Energy: 



dUy 

dt 



= Eh LV — Vhy + Qe 



dU L 

dt 



= Fhp — Eh LV — Lhp + Q — Qe 



2 . Transfer rate equations 

Mass: 



( 4 . 25 ) 

( 4 . 26 ) 



( 4 . 27 ) 

( 4 . 28 ) 



E = {k LV + k VL )A(P* - P) ( 4 . 29 ) 

Energy: 

Qe = ( ulv + uvl)A(T l — T v ) ( 4 . 30 ) 

where the subscript py means liquid to vapor and yp stands for 
vapor to liquid in the mass and heat transfer coefficients ki and 
u, . The coefficients for yp and py are normally different. 

3. Property relations 



hy = h v(Ty, P) 


( 4 . 31 ) 


h L = h L (T L ,P) 


( 4 . 32 ) 


h LV = h us(Tl,P) 


( 4 . 33 ) 


h F = h f(Tf, P ) 


( 4 . 34 ) 


P* = P *{T l ) 


( 4 . 35 ) 


PVy = —RTy 
m w 


( 4 . 36 ) 


Uy = Myhy(Ty, P) 


( 4 . 37 ) 


U l = M l \ve(T l ,P ) 


( 4 . 38 ) 




54 



4. Dynamic Process Models 





Pl 




(4.39) 




^lv = k us(T l ,T v ,P) 




(4.40) 




kyL = kvL (Tl, Ty , P) 




(4.41) 




ulv = ul v(T l ,T v ,P) 




(4.42) 




Uvl = UVL (Tl,T V ,P) 




(4.43) 




Pl = Pl{Tl, P) 




(4.44) 


4. 


Balance volume relations 








1 

£ 

II 

£ 




(4.45) 


where Vp is the total volume occupied by the vapor and liquid 
balance volumes. (In this case, it is the vessel volume.) 


5. 


Equipment and control relations 






L=h(M L ,P ) or L = f 2 (M L ) 


(4.46) 


6. 


Notation 






Boldface variables denote thermodynamic 


property functions. 


Other system variables are: 






My mass hold-up of vapor 


M l 


mass holdup of liquid 


Uy 


vapor phase internal energy 


U l 


liquid phase internal energy 


F 


feed flow rate 


V 


vapor flow rate 


L 


liquid flow rate 


E 


inter-plrase mass flow rate 


Ty 


vapor phase temperature 


T l 


liquid phase temperature 


Q 


energy input flow rate 


Qe 


inter-plrase energy flowrate 


p 


system pressure 


p* 


vapor pressure 


A 


interfacial area 


R 


gas constant 


Vy 


vapor phase volume 


Vp 


vessel volume 


hy 


vapor specific enthalpy 


hL 


liquid specific enthalpy 


hp 


feed specific enthalpy 


m w 


molecular weight 


PL 


liquid density 


hLV 


inter-phase vapor specific 


v L 


liquid phase volume 




enthalpy 
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Figure 4.1. A simple evaporator 



4.4 Heat Exchanger Examples 

Heat exchangers are one of the simplest units in process industries - they 
can be found in almost every plant. As their name suggests, heat exchangers 
are used for energy exchange between at least two fluid phase (gas or liquid) 
streams, a hot and a cold stream. Heat exchangers are usually distributed 
parameter process systems, but we can build approximate lumped parameter 
models of them using finite difference approximations of their spatial variables 
(as in the method of lines approximation scheme). A heat exchanger can 
then be seen as a composite lumped parameter process system consisting of 
elementary dynamic units as is depicted in Figure 4.2. 



4.4.1 Heat Exchanger Cells 

A heat exchanger cell is a primitive dynamic unit which consists of two per- 
fectly stirred (lumped) balance volumes (called lumps ) connected by a heat 
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Figure 4.2. A cascade model of a heat exchanger 



conducting wall. We shall call one of the lumps the hot (j = h) side and the 
other one the cold (j = c) side. The lumps with their variables are shown in 
Figure 4.2. (/a) 

1. Modeling assumptions 

In order to obtain a simple model with only two state equations, the following 
simplifying modeling assumptions are used: 

1. Constant volume and mass hold-up in both of the lumps j = c, h. 

2. Constant physico-chemical properties, such as 

• density: pj 

• specific heat: Cpj 

for both lumps, i.e. for j = c, h. 

3. Constant heat transfer coefficient ( U ) and area (A). 

4. Completely observable states, i.e. y(t) = x(t). 

2. Conservation balances 

The continuous time state equations of the heat exchanger cell above are the 
following energy conservation balances: 

T co (t) = - T co (t)) + -^( T ho (t ) - T co (t)) (4.47) 

v C CpcPc V c 

T ho (t) = Vj ^-{T hi {t) - T ho {t)) + (: T co {t ) - T ho (t)) (4.48) 

Vh C ph p h V h 

where Tj t and Tj a are the inlet and outlet temperatures, Vj is the volume 
and Vj is the volumetric flow rate of the two sides (j = c, h ) respectively. 

3. System variables 

The state vector is therefore composed of the two outlet temperatures: 

x\ := T co , x 2 '■= T ho (4.49) 

There are a number of possibly time-dependent variables on the right-hand 
side of the above equations which may act as manipulable input variables or 
disturbances, depending on the measurement and actuator settings and on 
any additional modeling assumptions we may have. These are as follows: 
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• the inlet temperatures: T C j and Thi, 

• the volumetric flowrates: v c and Vh- 

The special cases of the heat exchanger cell models are obtained by specifying 
assumptions on their variation in time. For every case, the output equation 
is 



y(t) = h(x(t)) 



Xi(t) 

x 2 (t) 



(4.50) 



4.4.2 LTI State-space Model of a Heat Exchanger Cell 

4. Additional modeling assumptions 

In order to obtain a finite dimensional linear time-invariant model in each of 
the cases, the following additional assumptions are applied: 

5. Constant volumetric flow rates. 

6. Manipulable inlet temperatures. 



5. State equations 

With assumptions 5 and 6 above, Equations (4.47)-(4.48) become the follow- 
ing finite dimensional LTI state equations: 





UA 


UA 




~ V c 


0 ' 

Vh 


X = 


Vc CPcpcVc 

UA 


CPcPcVc 
Vh UA 


X + 


Vc 

0 




CphPhVh 


Vh CphPhVh _ 




V h J 



(4.51) 



with 



u = 



T C i 

Thi 



(4.52) 



We may divide the state and input matrices in the above equations into 
additive terms related to the underlying mechanisms as follows. The state 
matrix term originating from energy transfer is 



A (tr > 



UA UA 

CPcPcVc CPcPcVc 
UA UA 

CphPhVh CphPhVh 



(4.53) 



The input and output convection to the lumps gives rise to the following 
terms in the state and input matrices respectively: 



j^(oconv) jg(iconv) 



- Vc. 
Vc 

0 



0 ' 

Vh 

v h J 



Using these matrices, we can write 

A = A t tr ' > — A^ oconv ^ B = B^ iconv ' > 



(4.54) 



(4.55) 
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4.4.3 LTV State-space Model of a Heat Exchanger Cell 

4. Additional modeling assumptions 

Let us change the additional assumptions of the previous Subsection 4.4.2 to 
have: 

5. Time- varying volumetric flow rates as disturbances. 

6. Manipulable inlet temperatures. 



5. State equations 

If one cannot assume constant volumetric flow rate, and only the inlet tem- 
peratures are manipulable, then the flow rates v c (t) and Vh(t) can be regarded 
as time-varying parameters in the LTI model equations in Equation (4.51). 
The transfer state matrix A ^ in Equation (4.53) then remains unchanged, 
but the convection state matrix and the input matrix change to 



A (° 



T^(iconv) 



\t) = B 



it) 



" Vc(t) 

v„ 

0 



0 

Vh(t) 

V h _ 



(4.56) 



The decomposition of the state-space model matrices does not change, but 
we have to use the new convection matrices to get 

A = A M - A (° conv \t), B = B^ iconv \t) (4.57) 



Note that the state and input vectors are exactly the same as they were in 
the case of the LTI model. 



4.4.4 Nonlinear State-space Model of a Heat Exchanger Cell 

In realistic cases, however, the assumptions leading to linear models are not 
valid, and the flow rates are the manipulable input variables. 

4. Additional modeling assumptions 

In order to obtain the simplest possible model from this class, the following 
additional assumptions are used: 

5. Manipulable volumetric flow rates, 

6. Constant input temperatures. 

5. State equations 

For the sake of simplicity let us introduce the following notation 

ui := v c , u 2 ■= v h 

, UA , UA 
«i := — , k 2 := — 

CpcPc * c CphPh vh 

Equations (4.47)-(4.48) can now be written as 



(4.58) 

(4.59) 
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Xi(t) 



— k\X\(t) + kiX2 (t) + 




yXi (t) ) «i(f) 



(4.60) 



X 2 (t) = k 2 xi(t ) - k 2 x 2 {t) + (^r- - ^-x 2 (t) S j u 2 {t) (4.61) 

The functions go(x),g\(x),g 2 {x) are written (with the f-arguments sup- 
pressed) as 



9o(x) = /( x) 



—k\X\ + k\X2 

k 2 x\ — k 2 x 2 



(4.62) 



9i(x) 
gi(x ) 



r Ten 1 1 

■€- 

o 

o 

Let w X2 J 



(4.63) 

(4.64) 



With the notation above we may write the state equations (4.60) and (4.61) 
in the following more general form: 



2 

x = A^x + E NiXUi + Bu 

i= 1 



(4.65) 



6. Mechanisms in the state equations 

In the above equation one can clearly see the origin of the terms on the 
right-hand side: 

• linear state transfer term A where 



r ua 


UA 




—ki k± 

ICri IC o 


CPcPc E: 
UA 


cp ^X c 


= 


cphphVh 


CPhPhVh _ 




'*'2 



(4.66) 



is a negative semi-definite singular matrix with one zero eigenvalue, 

• bilinear state convection term originating from the output convection with 





\-A- 01 


1 


'0 


0 


II 


v c 

0 0 


II 

£ 


0 


1 

v h . 



• linear input term originating from the input convection with 



(4.67) 



B = 




0 

Thi 

V h 



(4.68) 



7. Extensions 

It is important to note that the form in Equation (4.65) of the bilinear state- 
space model remains essentially the same if one considers the inlet tempera- 
tures to be time-varying. 
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• If their time variation is modeled via time-varying parameters, then the B 
matrix above becomes time- varying. 

• If they are regarded as additional manipulable input variables, then the 
input vector u is extended with two new suitably transformed input vari- 
ables: 



v c 

Vh 

TciVc 

ThiVh 



(4.69) 



4.5 CSTR Examples 

Continuously stirred tank reactors (CSTRs) are the simplest operating units 
in process systems engineering, because they consist of only a single per- 
fectly stirred balance volume. Therefore the engineering model of a CSTR 
contains precisely ( K + 1) differential equations, being the lumped conserva- 
tion balances for the overall mass, energy and the K components respectively, 
supplemented by suitable algebraic constitutive equations. 

The state equations are then derived from dynamic conservation balances 
of the overall mass and component masses, and energy if applicable, by sub- 
stituting the algebraic equations into the differential ones, if it is possible. 

This section contains two CSTR examples. The first one is a simple unsta- 
ble process system with an autocatalytic chemical reaction. The other one is a 
simple fermenter model, which we consider in both fed-batch and continuous 
operation mode. 



4.5.1 A Simple Unstable CSTR Example 

Let us consider an isothermal CSTR with fixed mass hold-up m and constant 
physico-chemical properties. A second-order autocatalytic reaction 

2 A + S -► T + 3A 



takes place in the reactor, where the substrate S is present in great excess. 
Assume that the inlet concentration of component A ( CAtn ) is constant and 
the inlet mass flow rate v is used as the input variable. 

1. Conservation balance equation 

The state equation is a single component mass conservation balance equation 
for component A in the form: 



drriA 

dt 



d(m • ca ) 

dt 



= VCAin ~ VCA + k ■ rn ■ Ca 



(4.70) 



where k is the reaction rate constant. Note that we only have a single balance 
volume, therefore C = 1. 
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In order to obtain a nonlinear state equation in its input-affine form, we 
need to center the conservation balance equation above. For this purpose a 
nominal steady-state is used as a reference state. The steady-state values of 
the system variables are denoted by a superscript asterisk. A given steady- 
state concentration c* A with a nominal mass flow rate v* satisfies: 

0 = v*(c A in -c* A ) + k-m (c^) 2 



From this we can determine v* as 

v * = k-m(c* A ) 2 

C A in C4 

which should be non-negative, therefore c A i n < c* A should hold. The given 
steady-state concentration c* A also determines the nominal value of the con- 
served extensive quantity m Al being the component mass in this case: 

m* A = m- c A 

4 . 5.2 A Simple Fed-batch Fermenter 

Fermenters are special bio-reactors of great practical importance. They are 
mostly regarded as CSTRs in which special fermentation reactions take place. 
Fermentation reaction rate expressions are usually quite complex and highly 
nonlinear. They are often the main source of nonlinearity in dynamic fer- 
menter models. 

1. Modeling assumptions 

The simplest dynamic model of a fed-batclr fermenter consists of three con- 
servation balances for the mass of the cells ( e.g . yeast to be produced), that 
of the substrate (e.g. sugar which is consumed by the cells) and for the overall 
mass. Here we assume that the fermenter is operating under isothermal condi- 
tions, so that no energy balance is needed. The cell growth rate is described 
by a nonlinear static function /i. The particular nature of a fermentation 
model appears in this so-called source function, which is highly nonlinear 
and non-monotonous in nature. 

Figure 4.3 shows the shape of the nonlinear reaction rate function. The 
maximum type character of the curve, that is, the non-monotonous property, 
is the one which makes the system difficult to control. 

Initially a solution containing both substrate and cells is present in the 
fermenter. During the operation we feed a solution of substrate with a given 
feed concentration Sf to the reactor. 

2. State equations 

Under the above assumptions the nonlinear state-space model of the fermen- 
tation process can be written in the following input-affine form [44]: 
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Figure 4.3. The fi function 



x = f(x) + g(x)u 



(4.71) 



where 





X\ 




'X' 


X = 


X-1 


= 


s 




_X3_ 




V 



(4.72) 



f(x) 



and 



ix(x 2 )xi 




k 1 +X2+k 2 X% 




Xl - 


-yH(X2)Xi 




l^maxX 2%1 


II 

"®1 


Sf-X2 




(ki+X 2 +k 2 x'^)Y 


X3 


0 




0 


I 


L 1 J 



(4.73) 



Kx 2 ) 



H"max%2 

k\ + X2 + k 2X2 



(4.74) 



3. System variables 

The variables of the model and their units are the following: 



x\= X cell concentration (state) [g/ 1 ] 

X‘2 = S substrate concentration (state) [g/ 1 ] 

X3 = V volume (state) [ 1 ] 

u — F feed flow rate (input) [ 1 /h] . 
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4. Model parameters 

A typical set of constant parameters and their values is as follows: 



Y = 0.5 


yield coefficient 




l^max — 1 


maximum growth rate 


[li 1 


h = 0.03 


Monod constant 


[g/1] 


k 2 = 0.5 


kinetic parameter 


[1/g] 


S f = 10 


influent substrate concentration 


[g/1] 


Xf= o 


influent cell concentration 


[g/1] 


Cl, c 2 


reaction enthalpy coefficients. 





4.5.3 Simple Continuous Fermenter Models 

For convenience, a relatively simple bio-reactor that is similar to the fed-batch 
case is selected but is now operated in continuous mode. 

Despite its simplicity, this model exhibits some of the key properties which 
render bio-reactors difficult to operate, and therefore proper controller design 
for bio-reactors is important. 

1. Modeling assumptions 

The continuous reactor is assumed to be perfectly stirred and an unstructured 
biomass growth rate model with substrate inhibition kinetics is chosen. 

The fermenter is considered to be isothermal with constant volume V and 
constant physico-chemical properties. 

2. Conservation balances 

The dynamics of the process are given by the state-space model derived from 
the conservation balances for the biomass with concentration X and substrate 
mass with concentration S. 



^ = n{S)X - ™ 


(4.75) 


dS »(S)X (Sf-S)F 

dt Y ' V 


(4.76) 


where /d(S) k-max x 2 S 2 +S+K! 


(4.77) 



The first equation originates from the biomass component mass balance, while 
the second is from the substrate component mass balance. They are coupled 
by the nonlinear growth rate function l(S)X , which is the main source of 
nonlinearity and uncertainty in this simple model. 

3. System variables and model parameters 

The variables and parameters of the model together with their units and 
parameter values are given in Table 4.1. The parameter values are taken 
from [44], 

4. State equations 

The above model can easily be written in standard input-affine form with the 
centered state vector 
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Table 4.1. Variables and parameters of the fermentation process model 



A' 


biomass concentration 






S 


substrate concentration 




[g/i] 


F 


feed flow rate 




m 


V 


volume 


4 


[i] 


Sf 


substrate feed concentration 


10 


[g/i] 


Y 


yield coefficient 


0.5 




f^max 5 


maximal growth rate 


1 


[l/h] 


I<i 


saturation parameter 


0.03 


[g/1] 


I<2 


inhibition parameter 


0.5 


[1/g] 



x=[X S] T = [X - X 0 S- S'o] 7 ’ 



consisting of the centered biomass and substrate concentrations. The centered 
input flow rate is chosen as manipulable input variable, i.e. 

u = F = F — F 0 



Then we have 



f(x) = 



x = f(x) + g{x)u 
+ S 0 )(X + X 0 ) - ( ™ o)F ° 



ti(S+S 0 )(X+X 0 ) 

Y 



(Sf — (S+Sq))F 0 
V 



(A'+A-p) 

(Sf-(S+S 0 )) 

V 



g(x) = 

with (Xq, So, Fq) being a steady-state operating point. 



(4.78) 



(4.79) 



5. Calculation of the optimal operating point 

The maximal biomass productivity XF is selected as the desired optimal 
operating point, i.e. the substrate cost is assumed to be negligible. This 
equilibrium point can be calculated from the nonlinear model: 



1 —2Ki + 2 <JK\ + S\K x K 2 + S f K x 

° ~ 2 S f K 2 + 1 

X 0 = (S F - S 0 )Y 

and the corresponding inlet feed flow rate is 



(4.80) 

(4.81) 



F 0 = n(S 0 )V 



(4.82) 



Substituting the parameter values from Table 4.1 gives 
S 0 = 0.2187 g/1, X 0 = 4.8907 g/1, F 0 = 3.2029 1/h 



(4.83) 
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6. Linearized model 

In order to compare linear and nonlinear model analysis and control tech- 
niques, the linearized version of the nonlinear model - state equations are in 
Equations (4.78)-(4.79) - is presented here: 



x = Ax + Bu 



(4.84) 



where 



'dr 




u (iGSg+So+Aq) 2 




dx 




-^l) Fq 




x—Q 


(A 2 S 2 +S 0 +A 1 )r (A 2 S 2 +S 0 +Ai)2 V _ 



(4.85) 



B = g(0) 



_^.Xo - 
Sf-Sq 



(4.86) 



L V J 

The steady-state point (X 0 , So, F 0 ) has been used in the linearized version of 
the model. The system matrices at the optimal operating point are: 



A = 



0 0.4011 

-1.6045 1.2033 ’ 



B = 



-1.227 

2.4453 



(4.87) 



4.6 Case Study: Modeling a Gas Turbine 

Gas turbines are important and widely used prime movers in transportation 
systems such as aircraft and cars. They are also found in power systems, 
where they are the main power generators, and in process plants as well. 
The investigation of steady-state behavior and static characteristics of gas 
turbines is a traditional area in engineering. This kind of model is based 
upon the characteristics of the component parts of the engine. The static 
characteristics can be given in the form of polynomials reflecting the results 
of the preliminary calculations or the measurements. 

This section is devoted to the model building of a low-power gas turbine 
[1], which will be used later on in the book as a case study for nonlinear 
analysis and control. 



4.6.1 System Description 

The main parts of a gas turbine include the compressor, the combustion 
chamber and the turbine. For a jet engine, there is also the inlet duct and 
the nozzle. The interactions between these components are fixed by the phys- 
ical structure of the engine. The operation of these two types of gas turbine 
is basically the same. The air is drawn into the engine by the compressor, 
which compresses it and then delivers it to the combustion chamber. Within 
the combustion chamber the air is mixed with fuel and the mixture is ignited, 
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producing a rise in temperature and hence an expansion of the gases. These 
gases are exhausted through the engine nozzle or the engine gas-deflector, 
but first pass through the turbine, which is designed to extract sufficient 
energy from them to keep the compressor rotating so that the engine is self- 
sustaining. The main parts of the gas turbine are shown schematically in 
Figure 4.4. In this section we analyze a low-power gas turbine, which is in- 
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Figure 4.4. The main parts of a gas turbine 



stalled on a test-stand in the Technical University of Budapest, Department 
of Aircraft and Ships. 

Engineering intuition suggests that the gas turbine is inherently stable 
because of its special dynamics. This is also confirmed by our measurements 
and simulation results. The most important control aim could then be to keep 
the number of revolutions constant, unaffected by the load and the ambient 
conditions (pressure and temperature) . The temperatures and the number of 
revolution has to be limited, their values are bounded from above by their 
maximum values. 



4.6.2 Modeling Assumptions 

In order to get a low order dynamic model suitable for control purposes, some 
simplifying modeling assumptions should be made. 

General assumptions that apply in every section of the gas turbine 

1. Constant physico-chemical properties are assumed. These include the 
specific heats at constant pressure and at constant volume, the specific 
gas constant and adiabatic exponent. 

2. Perfectly stirred balance volumes (lumps) are assumed in each main part 
of the gas turbine. This means that a finite dimensional concentrated 
parameter model is developed and the values of the variables within a 
balance volume are equal to those at the outlet. 
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Other assumptions 

3. Efficiency of the combustion is constant. 

4. In the compressor and in the turbine the mass flow rates are constant: 

vein = VCout = VC and V T in = VTout = V T 



4.6.3 Conservation Balances 

The nonlinear state equations are derived from first engineering principles. 
Dynamic conservation balance equations are constructed for the overall mass 
m and internal energy U for each of the three main parts of the turbine 
system [32]. The notation list is given separately in Table 4.2. 



Table 4.2. The variables and parameters of the gas turbine model 



Variables Indices 



m 


mass 


comb 


combustion chamber 


U 


internal energy 


fuel 


refers to the fuel 


T 


temperature 


C 


compressor 


P 


pressure 


T 


turbine 


n 


number of revolution 


in 


inlet 


c 


specific heat 


out 


outlet 


i 


enthalpy 


P 


refers to constant pressure 


M 


moment 


V 


refers to constant volume 


R 


specific gas constant 


comb 


refers to combustion 


V 


efficiency 


mech 


mechanical 


e 


inertial moment 


load 


loading 


V 


mass flow rate 


air 


refers to air 






gas 


refers to gas 



The development of the model equations is performed in the following 
steps: 

1. Conservation balance for total mass (applies to each section of the gas 
turbine): 

dm 

^ = v in - v out (4.88) 

2. Conservation balance for total energy in each section of the gas turbine, 
where the heat energy flows and work terms are also taken into account: 

dU _ 

7T — ^ irdin 

at 



V out lout + Q + W 



(4.89) 
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We can transform the above energy conservation equation by considering 
the dependence of the internal energy on the measurable temperature: 



dU 

dt 



d dm dT 

c v — (Tm) = c v T— + c v m — 



dt 



dt 



dt 



(4.90) 



From the two equations above we get a state equation for the tempera- 
ture: 



dT Vm/l'in ^out tout 4 Q 4 H C V T ( Vjn ISout) 

dt c v m 



(4.91) 



3. The ideal gas equation is used as a constitutive equation together with 
two balance equations above to develop an alternative state equation for 
the pressure: 



P 

T 



dp RT 

^ - \yin 0 0 ut) 

Viniin ^ out'lout ~4 Q T 11 C V T [yin Uout) 



(4.92) 



Note that both the extensive and the intensive forms of the model equations 
are used later for model analysis. 



4.6.4 Conservation Balances in Extensive Variable Form 



The state equations in extensive variable form include the dynamic mass con- 
servation balance for the combustion chamber, the internal energy balances 
for all of the three main parts of the turbine and an overall energy balance for 
the system originating from the mechanical part. The indices in the balance 
equations and variables therein refer to the main parts of the turbine: to the 
compressor ( i = 2), to the combustion chamber ( i = 3) and to the turbine 
(i = 4), while the inlet variables are indexed by i = 1. 

Thus five independent balance equations can be constructed, therefore 
the gas turbine can be described by only five state variables. 



= V C + V fuel - vt 



(4.93) 



Total mass balance 

dmcornb 
dt 

Total energy balance 

^ = vcCpairiTi - T 2 ) + v T c pgaa (T 3 - T 4 )r j mech - 277^?iM ioad (4.94) 
—JjT ~ ^C^pairT2 lSTC pgas T 3 Q fTjcomblS fuel (4.95) 

dUi frr ^ v c c vair {T 2 - Ti) 277 3 

— — = v T c pgaa (T 3 - T 4 ) — -nMi oad (4.96) 

dt Pmech Pmech 50 

Mechanical dynamic equation 

dP 3 

-Ml = u T c pgas (T 3 - T 4 ) rjmech - v c Cpair(T 2 - T 4 ) - 277— nMioad (4.97) 
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4.6.5 Model Equations in Intensive Variable Form 

There are several alternatives for the model equations in intensive variable 
form. We choose the set that includes the dynamic mass balance for the com- 
bustion chamber (that is, Equation (4.93)), the pressure form of the state 
equations derived from the energy balances and the intensive form of the 
overall mechanical energy balance, expressed in terms of the number of rev- 
olutions n. 



dp 2 

dt 



1 L air / /m 

77 {VC c pair{-Ll 

v C^v air 



ftbc . , PzVcomb 

) + V T Cpgasi 5 

me Hair m(j orn b rimed 



)llmech ~ 2II-^-nMi oad ) 



dt mComb 



{VC + V fuel ~ Vt) + 



d^med, / P2^C 

' 77 \ U C c pair 5 

VCombCvmed me riai \ 



^T^pgas 



P^Vcomb 

mCombdt 

med 



1 , PsVcomb / u 

Ttj/ fTJcombV fuel Cymed p [yC “T Vf ue i Vf )) 

"I'C omb-K'med 



dpi Rg 



P?,VComb 



u, r'4 _ tygas / f Vi y Comb 

dt V T C vgas VTCP9<1S ^ mCombRmed 



PaVt X _ V C Cpair ( ^ R c air T± ) _ 277 3 . 

m T Rgas Vmech Vmech 50 ™ l ° ad 

dn _ 1 ( f p 3 V C omb PaV T ^ 

dt - Am On [UTCp9as[ rncombRmed m T R gas )T]mech 

~V C Cpair ( P 2 p C ?l) - 211 ^~nMi oad ) 

m C Rair 50 



4.6.6 Constitutive Equations 

Two types of constitutive equations are needed to complete the nonlinear gas 
turbine model. The first is the ideal gas equation 

T= — 
inR 



which has already been used before, and has been substituted into the state 
equations to get alternative intensive forms. 

The second type of constitutive equations describes the mass flow rate in 
the compressor and in the turbine. 



vc = const(l)g(Ai) 



Pi 

VT 



(4.102) 
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vt = const(2)g(A 3 ) 



P 3 

Vn 



In these equations g(Ai) and q( A 3 ) can be calculated as follows: 



?(A 3 ) = /(const (3) 






P3Vb omb _ P4 
WlC omb Rmed 



(4.103) 

(4.104) 

(4.105) 



The parameters and constants of these functions can be determined using 
measured data and the compressor and turbine characteristics. 



4.6.7 Operation Domain and System Variables 

The measurable intensive set of state variables for the gas turbine test stand 
at the Technical University of Budapest is: 

x=[m Co mb P2 P3 Pa n] T (4.106) 

Experimental values of these variables are constrained to the following do- 
main: 

0.003 < mcomb < 0.0067 [kg] 180000 < p * 2 < 280000 [Pa] 

170000 < pi < 270000 [Pa] 100000 <p\< 140000 [Pa] 

39000 <n< 51000 [1/min] 

The value of the only input variable vj U ei is also constrained by: 

0.009 < vjuei < 0.017 [kg/sec] 

The set of possible disturbances includes: 

d=[Ti pi M terh f (4.107) 

where the domain of its elements is: 

273 < Ti < 310 [K] 97000 < Pl < 103000 [Pa] 0 < M terh < 180 [Nm] 

Finally we construct the set of output variables by noticing that all the pres- 
sures p* and the number of revolutions n in the state vector above can be 
measured, but the mass mcomb cannot: 



V=[P2 P 3 Pa n) 



(4.108) 
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4.7 Summary 

The basic approach and a systematic methodology for constructing lumped 
dynamic process models from first engineering principles is introduced in this 
chapter. The most important mechanisms (convection, transfer and a source 
term associated with chemical reactions) are also discussed in detail and their 
effect on the algebraic form of the state equations is also described. 

The modeling methodology is illustrated in several case studies of sim- 
ple, yet practically important, process systems: heat exchangers, continuously 
stirred tank reactors including bio-reactors, and a gas turbine. The nonlinear 
state-space models developed here will be used for nonlinear model analysis 
and control studies throughout the book. 



4.8 Questions and Application Exercises 



Exercise 4.8.1. Which are the canonical extensive variables and related po- 
tentials of lumped process systems? 

Exercise 4.8.2. What are the general expression for total mass balance in 
a process system? Describe the significance of each term. 

Exercise 4.8.3. What are the principal mechanisms in lumped process sys- 
tems? How can we decompose the state equation of a lumped process system 
driven by mechanisms? 

Exercise 4.8.4. What are the most important classes of constitutive equa- 
tions? Which ones of those play role in dynamic modeling for control? 

Exercise 4.8.5. What are the general expressions for energy balance in a 
process system? Describe the significance of each term. 

Exercise 4.8.6. Develop a special case of the simple evaporator model de- 
scribed in Example 4.3.1 assuming constant physico-chemical properties. 
Construct the state equations of the system by substituting the algebraic 
constitutive equations into the differential ones. 



Exercise 4.8.7. Develop a special case of the simple fed-batch fermenter 
model described in Subsection 4.5.2 assuming a more simple fermentation 
kinetics: 



H(S) = \i 



max 



s 

K 2 s + K\ 



Construct the state equations of the system. 



Exercise 4.8.8. Construct an LTI state-space model of the heat exchanger 
cell described in Subsection 4.4.2 using centered variables. Compare the ob- 
tained model with the one in Equations (4.51). 
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Exercise 4.8.9. Construct a bilinear state-space model of the heat ex- 
changer cell described in Subsection 4.4.4 using centered variables. 

Exercise 4.8.10. Develop a linearized state-space model of the nonlinear 
heat exchanger cell described in Section 4.4.4. 




5. Input— output Models and Realization 
Theory 



Basic notions of signals and systems (see Chapter 2) suggest that input- 
output description is the natural description of dynamic systems represented 
as an abstract operator S acting on the input space and producing a signal 
from the output space. If we only use the input and output signals (possibly 
together with disturbances) for the description, then we have an input-output 
model or description of the system in question. 

This chapter is devoted to the detailed elaboration of this concept of 
input-output description both for continuous time finite-dimensional LTI 
and nonlinear systems. 

The material in this chapter is arranged in the following sections: 

• Input-output models of LTI systems 

The basic notions of both the time domain and frequency (operator) do- 
main description are introduced. 

• Input-output representation of nonlinear systems 

The basic representation forms of LTI systems are generalized to cover 
the general finite dimensional nonlinear case. Both the Fliess and Volterra 
series representations are described. 

• Realization theory 

A brief introduction is given here on how to find state-space models for a 
given input-output model in both the LTI and nonlinear case. 

• Zero dynamics 

The notion of zero dynamics is very useful when designing output feedback 
controllers to a nonlinear system. It is introduced here and its computation 
is illustrated for a simple process system example. 



5.1 Input— output Models of LTI Systems 

Usually we do not use the abstract system operator S when we want to de- 
scribe a concrete system for the purpose of its analysis and control. Instead, 
we use different other descriptions: system models or system representations 
mainly in the form of differential and algebraic equations. The following sub- 
sections deal with different input-output and state-space representations of 
continuous time LTI systems. 
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For the sake of simplicity we only deal with single-input- single-output 
(SISO) systems here, but the different models can be easily generalized to 
the MIMO case, as well. A SISO LTI system is usually described either in 

• time domain, or in 

• operator domain. 

5.1.1 Time Domain Description 

There are different alternative methods for the input-output description of 
LTI systems in time domain: linear lriglrer-order differential equations with 
constant coefficients and the impulse-response function description. 

Linear Differential Equations with Constant Coefficients. Let us de- 
note the scalar output signal of the system by y and the scalar input by 
u. Then the system model is in the form of a linear higher-order ordinary 
differential equation: 

d n y d n ~ 1 y dy du d m u 

a n^+ + - + «1 It + aoV = b 0 n + b 1 - + ... + b m — (5.1) 

with given initial conditions 

2/(0) = 2/00, ^r(O) = yio, , d dtn j( (0) = Vno 

because the input function u and its derivatives are considered to be known 
(given) for every time instant. Observe that we need n initial conditions for 
this description. 

The parameters of this system model are the constants 
(uo, ui, • • • j n rl ) * (6o, bir ... ? hra) 

This system model is clearly 

• linear , because the equation is linear, and 

• time-invariant because the model parameters are constant (do not depend 
on time). 

Impulse-response Representation. 

Definition 5.1.1 (Impulse-response function) 

The impulse-response function is the response of a SISO LTI system to a 
Dirac-5 input function with zero initial condition. 

The concept of impulse-response representation is illustrated in Figure 5.1 
below where 

h(t): impulse-response function 

6(f): Dirac-5 function. 
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Figure 5.1. Notion of the impulse-response function 



The output of S can be written as 




h(t — t)u(t)<1t 




h(r)u(t 



r)dr 



(5.2) 



The equation above describes the convolution of h(.) and u(.) in time domain. 

We can develop two equivalent forms from the above defining equations 
(5.2) as follows: 

1. Because u(.) is a function Kj — > K, we start the integration at time 0. 
The upper bound for the integration is t because the system is causal , 

i.e. 

y(t) = f h(t — t)u(t)<1t (5-3) 

Jo 

The above integral formulation is only valid under the so-called “zero 
initial condition” assumption, when {u(t) = 0 | t < 0}. This condition 
will be reformulated later on for state-space representations. 

2. We can observe that h(t) is also identically zero up to the time t = 
0 because of the definition and the causality of the system. Therefore 
Equation (5.2) specializes to 

POO 

y(t) = / h(r)u(t — r)dr (5-4) 

Jo 



5.1.2 Operator Domain Description 

In operator domain we work with the Laplace transform (denoted by C, 
abbreviated by L-transform) of signals. The Laplace transform is defined in 
Section 2.1.4. 

The description of an LTI system in operator domain uses the transfer 
function H(s) of the system. 
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Definition 5.1.2 (Transfer function) 

The transfer function of a SISO LTI system is a complex function which is 
defined as follows: 

Y{s ) = H(s)U(s) (5.5) 

assuming zero initial conditions with 

Y (s) Laplace transform of the output signal 

U (s) Laplace transform of the input signal 

H (s) = transfer function of the system 

where a(s) and b(s) are polynomials and 
degree b(s) = m 
degree a(s) = n. 

We can easily connect the time domain differential equation description (5.1) 
of a continuous time SISO LTI system with the transfer function description 
if we take the Laplace transform of Equation (5.1) with zero initial conditions 
and compare the result with Equation (5.5). 

Using property (3) of the Laplace transform and the defining equation 
of the transfer function (5.2) it is easy to show that H(s) is the Laplace 
transform of the impulse-response function h(t ) of the system S: 

H(s ) = C{h(t) } (5.6) 



Definition 5.1.3 (Proper transfer function) 

Let the transfer function of a continuous time SISO LTI system be in the 
form of H(s) = ^y with n = deg (a(s)),m = deg (b(s)) being the degrees of 
the denominator and nominator polynomials respectively. If 

to < n then H(s) is strictly proper 

to = n proper 

to > n improper. 

It is important to note that realistic causal systems are strictly proper there- 

fore it will be assumed from now on. 

5.1.3 Input output and State-space Representations of LTI 
Systems 

The concept of state-space models has already been introduced in Chapter 3. 
It is of great importance to find connections between state-space and input- 
output realizations of a given LTI system. Here we consider the problem of 
constructing various forms of input-output models to a given LTI state-space 
model or realization. 
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Definition 5.1.4 (Equivalent realizations) 

Equivalent state-space realizations (or models) are the ones which give rise 
to the same input-output description, that is to the same transfer function 
in the LTI case. 

The general form of state-space models of LTI systems has been already 
introduced in Section 3.2.1 in the form: 

xft) = Ax(t) + Buff), x(0) = Xo 
yft ) = Cx(t ) + Duff) 

which is characterized by the matrix quadruplet (A, B,C, D) where usually 
D = 0 is assumed. 

Construction of the Transfer Function from State-space Models. 

Assuming that x(0)=0, we can easily derive the transfer function from the 
state-space model equation above by computing the Laplace transform of 
both equations and substituting A(s) from the transformed state equations 
to the output equation: 

X(s) = (sI-A)-'BU(s) 

Y(s) = {C(sI-A)- 1 B + D}U(s) [ 1 

The last equation gives the transfer function H(s) of the state-space repre- 
sentation matrices (A, B , C, D): 

H(s) = C{sI-A)~ 1 B + D (5.8) 

The above derivation shows that the transfer function can be computed from 
the realization matrices ( A , B, C , D) therefore their combination in Equation 
(5.8) is realization-independent. 

There are other more simple quantities which are realization-independent 
in the case of LTI systems. The most important of them are the Markov 
parameters defined below. 

Definition 5.1.5 (Markov parameters) 

The Markov parameters of a continuous time LTI system with state-space 
realization ( A,B,C ) are defined as: 

hi = CA i ~ 1 B, i= 1,2,... (5.9) 

It can be shown that the Markov parameters are invariant under state trans- 
formations, that is, they remain unchanged if one applies a state transforma- 
tion using an invertible transformation matrix T. 
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Construction of the Impulse-response Function from State-space 
Models. We can relate the parameters of a given state-space model to the 
impulse-response function in two ways. The first way is to use the solution 
of the state equation and remember that the impulse-response function h(t) 
of a LTI system is its output for the Dirac-5 (5(f)) input and we obtain with 
D = 0: 

t 2 

h(t) = Ce At B = CB + CABt + CA 2 B- + ... (5.10) 

The same result is obtained by taking the inverse-Laplace transformation of 
Equation (5.8) with D = 0. 

Note that the Markov parameters are present in the time series expansion 
of the impulse-response function h{t). 



5.2 Input— output Representation of Nonlinear Systems 

The input-output representation of finite dimensional nonlinear systems is 
much more difficult than that of LTI systems. Besides the mathematical 
difficulties present in the various representations, one has to cope with the 
infinite series inherent in the various representations. 

5.2.1 Fliess’s Functional Expansion 

First, we summarize the necessary mathematical tools and definitions for the 
input-output description of nonlinear systems based on [37]. 

Definition 5.2.1 (Multi-index) 

Let Ik denote the set of all sequences (ik . . . *i) of k elements ik, ■ ■ ■ ,i i of the 
index set I. A multi-index is an element of Ik- The only element of Iq is the 
empty sequence (i.e. a multi-index of length 0), denoted by 0. 

In the case of an input-affine nonlinear system with m inputs, the index set 
is I = {0, 1, ...,m}. Furthermore, let us introduce the following notation: 

/* = U 4 (5.11) 

fc >0 

Definition 5.2.2 (Formal power series) 

A formal power series in m + 1 noncommutative indeterminates and coeffi- 
cients in M is a mapping 

c :/*->] R (5.12) 

The value of c at some element 4- ■ • • *o of I* is denoted by c(ik • ■ • *o) ■ 
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Definition 5.2.3 (Iterated integrals) 

Let T be a fixed value of the time and suppose u \ , . . . , u m are real-valued piece- 
wise continuous functions defined on [0, T], For each multi-index (ik ■ ■ ■ io) the 
corresponding iterated integral is a real-valued function of t 

df ,, ■ ■ ■ df. n dfi 0 
defined for 0 < t < T by recurrence on the length, setting 




Co (t) = t 

fi{t) = / Ui(r)dr for 1 < i < m 

J o 

and 

/ dfi k . . . dfi 0 / dfi k (r) / dfi k _ 1 . . . dfi 0 

Jo Jo Jo 

The iterated integral corresponding to the multi-index 0 is the real number 1. 



Example 5.2.1 (The first few iterated integrals) 



The iterated integrals are computed in a recursive way following 
the recursive structure of their definition. 



Co (t) = t 



C i(t) 



dii 




dt 



for 1 < * < m 




u(r)dT 



2 ! 



f f u(6)d6dr 

Jo Jo 

[ w(r)rc?r 



la 



u(t) 



u(6)de\ 



dr 



(5.13) 
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The Fliess’s series expansion makes use of the iterated integrals above to 
obtain an input-output representation of lumped nonlinear systems in the 
form 

V = S[u], u&U^y&y (5.14) 

where S is the system operator, u is the input, y is the output, and U and y 
denote the input and output signal spaces with dim(W) = m and dim((V) = p 
respectively. 

Theorem 5.2.1 (Fliess’s series expansion of nonlinear systems). Sup- 
pose the inputs of the nonlinear system (5. If) satisfy the con- 

straint 

max |ui(r)| < 1 

0<t<T 

Then, if T is sufficiently small, the j-th output yj(t) of the system (5.1 4) 
may be expanded in the following way: 

oo m pi 

Vj (t) = hj (a: 0 ) + L 9i 0 ■ • ■ L 9i k h j ( x °) / ■ ■ ■ d &o ( 5 - 15 ) 

fc=0 io,...,ife=0 ® 



where g 0 = f. 

5.2.2 Volterra Series Representation 

The convolution integral in (5.2) can be generalized and applied to a large 
class of nonlinear systems. The result of this generalization is the so-called 
Volterra- series description, where we describe the input-output behavior of 
the system using a series of so-called generalized convolution integrals. The 
linear case in Equation (5.4) is a special case of this representation. 

For simpler notation, let us consider a nonlinear input-affine system model 
with scalar output, i.e. Equation (3.19) being in the form of 

x(t) = f(x(t)) + Y:Zi9Mt))n i (t) 

y{t) = h(x(t)) 

with dim?/ = p = 1. The output of a system can be approximated with the 
series 

y{t) = w 0 (t ) + 

°° ft PTi pTk-1 

Y, I / •••/ w k (t,T 1 ,...,T k )u(r 1 )...u(rk)dT k ...dri (5.16) 

k=1 -'o Jo Jo 

where Wk(t , tt, . . . , Tfe) is called the k-th order Volterra kernel. 

Let us denote the flow of the vector field / in Equation (3.19) by /* (i.e. 
f f (x) is the solution of the equation above at time t starting from x(0) = x 
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with u = 0). It can be shown (see, e.g. [21]) that the Volterra kernels are 
calculated as 



w 0 (t) = ho /*(x 0 ) 

Wk(t,Tl, . . . ,Tfe) = 

L g (...(L g (L g (h Of*-*) O /n-r 2 )o/ r 2 -r 3 )o ... o/ r fc _ 1 -r fc)o/ r )t(a;o) 

k = 1 ) 2 ,... 

(5.17) 



The main result from the convergence of (5.17) is that if /, g and h are 
analytic in a neighborhood of .To then there exists T > 0 such that for each 
input function satisfying \u(t)\ < 1 on [0,T], the series (5.17) is uniformly 
absolutely convergent on [0,T] (see, e.g. [21]). 



5.2.3 Higher-order Nonlinear Differential Equations 

Similarly to the time domain input-output description of LTI systems de- 
scribed in Section 5.1.1, under some conditions the relation between the in- 
puts and outputs of a nonlinear system (3.19) can also be represented using 
a set of higher-order differential equations of the form 

Fi ...,u (k \y,y, ...,y (fc) ) = 0, i=l,...,p (5.18) 

The conditions and the complete algorithm for rewriting the state-space 
model (3.19) into the form (5.18) can be found in [21]. The following simple 
example will illustrate the method without going too much into the details. 



Example 5.2.2 (Nonlinear input output model) 

Rewriting a simple nonlinear state-space model into input-output, 
form 

Consider a simple nonlinear process model describing the opera- 
tion of a continuous fermenter which has been introduced in Sub- 
section 4.5.3: 

X\ 

±1 = t 2 )ti - — u (5.19) 

h{x 2 )ti S f - x 2 

X 2 = Y + ~ ^ 

y = x 2 



where = k+x 2 anc ^ ^ anc ^ ^ F are cons t an l s - 



(5.20) 

(5.21) 
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To express the direct relationship between u and y, x\ and x\ 
should be eliminated from Equations (5.19)-(5.20). First, let us 
express aq from (5.20) using the output equation y = aq: 



aq 



Y f (S F - y)u 
Kv) V V 



(5.22) 



Taking the time derivative of (5.22) gives 
—Y 

Xi = ^7 ( KS F yu - KVy 2 + uy 2 y - KS F yii 

+Ky 2 ii + KVyy — S F y 2 u + y 3 ii + Vy 2 y) (5.23) 

Substituting (5.22) and (5.23) back into (5.19) gives the required 
(and quite complicated) time domain input-output relation of the 
model. 



5.3 Realization Theory 

The realization problem for a given input-output representation is to com- 
pute and characterize the properties of state-space representations that cor- 
respond to a specified linear or nonlinear system. In this sense, the realization 
problem is the reverse of the problem described in Subsection 5.1.3. 



5.3.1 Realization of LTI Systems 

Firstly, the realization problem of an SISO system from a given transfer func- 
tion H(s) is considered. The notations and the line followed in this subsection 
are based on [57]. The form of linear state equations we want to obtain is 

x = Ax + Bu, x(0) =0 
y = Cx 

where x £ R", A £ M nx ", B £ K nxl and C £ R lx ". Of course, the model 
(5.24) must satisfy H(s ) = C(SI — A)~ 1 B. The unknowns in the problem are 
the dimension of the state-space n and the matrices A , B and C. Of course, 
we are interested in finding a state-space model with minimal state-space 
dimension n. We know from Subsection 3.2.2 that state-space models are 
not unique, therefore we cannot expect a unique solution of the realization 
problem. 

The term (si — A)~ x can be expanded into a negative power series in the 
following way: 

(si - A)~ 3 = Is -1 + As~ 2 + A 2 s~ 3 + ... 
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therefore 

C(sl - Ay'B = CBs - 1 + CABs~ 2 + CA 2 Bs~ 3 + ... 

where the coefficients h t = CA l ~ 1 B, * = 1,2,... are the so-called Markov 
parameters. From this, it’s clear that the realization problem for LTI systems 
is to find a state-space representation of the transfer functions of the form 

H(s) = hi s 3 + h. 2 S 2 + h 3 s 3 + . . . 

To state the realization problem first in a more abstract way, let us define 
three operators. 

Let Z(s) be a negative power series of the form 

Z(s) = k\S _1 + k 2 s~ 2 + k 3 s~ 3 + . . . (5.25) 

A shift operator S is defined as 

S Z(s) = h 2 s~ 1 + k 3 s~ 2 + kiS~ 3 + . . . (5.26) 

i.e. S shifts the coefficients of a power series one position to the left, and the 
left-most coefficient is dropped. The repeated (fc-times) application of the 
shift operator is denoted by S fe . 

Using the shift operator and the transfer function H(s), we can specify a 
linear space of negative power series over the real numbers as 

U = span {H(s), SH(s), S 2 H(s), ...} (5.27) 

It can be seen that the shift operator is an operator on U, S : U i— > U. 

We define the initialization operator L : R i— > U as 

Lr = H(s)r (5.28) 

The evaluation operator E : U i— > R. applied to a negative power series of 
the form (5.25) is defined as 

E Z{s) = ki (5.29) 

It is possible to show that the linear operators S, L and E form a so-called 
abstract realization on the linear space U. This is often called the shift real- 
ization and it is denoted by (S, L, E, U). 

The composition of L, S and E gives the Markov parameters: 

ES°L = E H(s) = h 3 
ESL = ES H(s) = h 2 
ES 2 L = ES 2 H(s) = h 3 

: (5.30) 

The following theorem provides a necessary and sufficient condition for the 
realizability of a linear time-invariant system in abstract terms. 
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Theorem 5.3.1 (Realization of SISO LTI systems). A SISO LTI sys- 
tem described by the transfer function H(s) is realizable in the form (5.2 f) 
if and only if the vector space U is finite dimensional. Furthermore, if the 
system is realizable, then (S,L,E ,U) is a minimal linear realization. 

Algorithm for Obtaining a Minimal Realization. The method for ob- 
taining a minimal realization of the form (5.24) is the following. Suppose that 
H (s) is linearly realizable and thus U has finite dimension n. Then it can be 
shown that the abstract vectors 



H(S), SiT(s), . . . , S" _1 fT(s) 



form a basis in U. Let us now identify these vectors with the standard basis 
vectors e* € R”, * = 1, . . . , n 

ei = H(s), e 2 = SH(s), ..., e n = S”- 1 fL(s) (5.31) 



and write S n H(s) as a linear combination of the basis vectors: 



S n H(s) = ^r 4 S i “ 1 U(s) 

Then the n x n matrix A represents the shift operator as follows: 





'0 0.. 


. 0 ri 




10.. 


. 0 r 2 


A = 


0 1.. 


■ 0 r 3 




0 0.. 


• 1 r n _ 



(5.32) 



(5.33) 



Since the initialization operator L maps from a one-dimensional vector space 
to an n-dimensional space, it can be represented by an n x 1 vector. From 
the definition of the operator it is clear that this vector is 



B = e i = 



1 

0 



(5.34) 



The evaluation operator E maps from an n-dimensional space to a one- 
dimensional space, therefore it can be represented by a 1 x n dimensional 
vector. It can be seen from (5.30) that Ee; = hi for i = 1, . . . ,n — 1. Thus, E 
can be given by 

C=[h 1 h 2 ...h n ] (5.35) 

In conclusion, we have generated a state-space representation in the form of 
Equation (5.24) with the matrices ( A , B, C ) above. 
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Realization using Hankel matrices. In Section 5.1.3 it was shown that 
the Markov parameters of an LTI system model are realization-independent. 
Another useful realization-independent structure composed of Markov pa- 
rameters is the Hankel matrix of an LTI system. 

Definition 5.3.1 (Hankel matrix, LTI case) 

The Hankel matrix of an LTI system G is an infinite matrix of the form 



H g 



hi /12 hs . . . 
h2 h% hi . . . 
h:i /14 /15 . . . 



(5.36) 



Note that the Hankel matrix depends only on (A, B, C) in the form of the 
coefficients of hi = CA l ~ 1 B. 

Theorem 5.3.2 (Realization of SISO linear systems using Hankel 
matrices). A linear system described by the transfer function H(s) is re- 
alizable in the form (5.2 4) if and only if its Hankel matrix Hq is of finite 
rank. Furthermore, the rank of Hq is the dimension of the minimal linear 
realization of H (s) . 



Finally, we give another necessary and sufficient realizability condition that 
corresponds to MIMO linear systems and which is the easiest to check in 
practice. For this, consider the linear state-space model 



x = Ax + Bu 
y = Cx , a;(0) = 0 



(5.37) 



where x £ M", u € R r , y £ and the matrices A , B and C are of appropriate 
dimensions. The transfer function of (5.37) is the p x r matrix 

H(s) = C(sl — A)~ 1 B 



Theorem 5.3.3 (Realization of MIMO linear systems). Consider a 
linear system described by a p x r transfer function matrix H{s). Then the 
system is realizable by a finite dimensional linear state equation of the form 
(5.37) if and only if each element Hij(s) of H(s) is a strictly proper rational 
function. 



5.3.2 Realization Theory for Nonlinear Systems 

The task of finding a state-space realization of a nonlinear system from its 
input-output model is described by the following problem statement: given 
a nonlinear input-output description of a system, determine a state-space 
realization of the form (3.19): 

x(t) = f{x(t))+Y,Z 1 g i (x(t))u i (t) 
y(t) = h(x(t)) 
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Definition 5.3.2 (Realization of a formal power series) 

The set {go, ■ ■ ■ ,g m , h, £ 0 } w ^h go = f is called a realization of a formal 
power series c. 

The Hankel matrix and Hankel Rank of Nonlinear Systems. The 

Hankel matrix of a nonlinear system plays a central role in realization theory. 
Its definition is a non-trivial extension of that of LTI systems as is described 
in abstract terms below. 

Definition 5.3.3 (Hankel matrix, nonlinear case) 

Given a formal power series c as an input-output realization of a nonlin- 
ear system. An infinite matrix H c , in which each block of p-rows of index 
(■ i r , . . . ,i o) on the column of index ( jk , ■ • • , jo) is exactly the coefficient 

c(i r ... ip jk • • • jo) 

of c, is called the Hankel matrix of the series c. 

Definition 5.3.4 (Hankel rank) 

The rank of the matrix H c above is called the Hankel rank of the system. 

Note that the Hankel rank is not necessarily finite because the Hankel matrix 
is an infinite matrix. 

Construction of the Hankel Matrix for Nonlinear Systems. Before 
approaching the construction of Hankel matrices from a Fliess’s series expan- 
sion, some useful notations are introduced. 

In order to enumerate the elements of the nonlinear Hankel matrix in a 
systematic way, we need to index its elements with the elements of I* as 
follows: 

1. An infinitely long column vector is indexed as: 

index element 

(0) a 

(1) b 

(00) c 

(01) d 

(10) e 

( 11 ) / 

a, b , c, d , e, /, ... € R 

2. An infinitely long block-column vector consisting of p-blocks, that is of 
column vectors with p elements, is also indexed with the elements of I*. 
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index element 

(0) ai 

02 

CLp 

(1) h 
b 2 

bp 

a,b G K p 

Now we can construct the Hankel matrix of a nonlinear system represented 
by its Fliess’s series expansion (see Equation (5.2.1)) by indexing 

• its columns with the elements of I*, and 

• its row-blocks of length p with the elements of I*. 

Then the construction rule applies to the following items: 
row-block index: (i r . . . i 0 ), 

column index: (jk ■ ■ - jo), 

matrix element : c(i r . . . iojk ■ ■ • jo) 

where c{ik ■ ■ ■ i o) = L gi0 . . . L gik h( xq) and c(0) = h(x o) are the coefficients of 
the Fliess’s series expansion. 

Let us consider a special case, a nonlinear system with one input and p 
outputs. Then the first few columns of the Hankel matrix are as follows: 



Columns 0, (0), (1), (00) 





0 


(0) 


(1) 


(00) 


0 


hi(xo) 


Lfh\{xo) 


Lghi(xo) 


Ljhi(xo) 


(0) 


h p (xo) 

Lfhi(x 0 ) 


Lfh p (x o) 
L 2 fhi(xo) 


Lgh p (x o) 

L g L f h 1 (x 0 ) 


L 2 fhp(x o) 
Lfhi(xo) 


(1) 


Lfh p (x o) 
L g hi(xo) 


L 2 hp(x o) 
LfL g hi(x 0 ) 


L g Lfhp(x o) 
L 2 ghi(x 0 ) 


L 3 fh p (xo ) 

L y L g h i(xo) 


(00) 


Lghplx o) 

L 2 f hi(x 0 ) 


LfL g hp(xo) 

L 3 f hi(x 0 ) 


Lghp^xo*) 

L g L 2 hi(xo) 


L * Lghp (xo) 
Lj hl (x o) 




L 2 f hp(x o) 


L 3 fh p (xo) 


LgLfh p (xo) 


Lfh p (xo) 
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Columns (01), (10), (11) 





(01) 


(10) 


(H) 


0 


L g Lfhi(xo) 


LfL g h\{xo) 


L'gh\(xo) 


(0) 


L g L fh p (x o) 


LfLgh p {x o) 


Lgh p (x 0 ) 


(1) 








(00) 









5.3.3 Realization of Bilinear Systems 

As we have already seen in Section 3.5.3, bilinear systems are special, easy-to- 
handle types of nonlinear input-affine systems. This is also true in realization 
theory: special strong results apply to bilinear systems which are the subject 
of this subsection. 

The following example shows the structure of a Hankel matrix of bilinear 
systems. 



Example 5.3.1 (Hankel matrix of a bilinear system) 

Construction of the Hankel matrix for a simple SISO bilinear sys- 
tem 

Consider first a simple special SISO bilinear state-space model in 
the form: 

x = Ax + Nxu, y = h(x) = Cx 

and let us introduce the following notation: No = A, Ni = N. 
Then the coefficients of the Fliess’s series expansion as an input- 
output model of the system are in the following simple form: 

c(0) = Cx o 
c{fk ■ • - ffi) C J\ . . . N.i 0 Xo 




5.4 Hankel Matrix of a 2-input-2-output Bilinear Heat Exchanger Cell model 



Finally, the Hankel matrix of the system is as follows: 





0 


(0) 


(1) 


0 


Cx o 


C Ax o 


CNx o 


(0) 


C Ax o 


CA 2 x o 


CANxq 


(1) 


CNx o 


CNAx 0 


CN 2 x 0 . . . 



The following theorem shows the importance of finite Hankel rank and bilin- 
ear system representations at the same time. 

Theorem 5.3.4 (Existence of bilinear realization). Let c be a formal 
power series in m + 1 non- commutative indeterminates and coefficients in 
R p . There exists a bilinear realization of c if and only if the Hankel rank of c 
is finite. 



5.4 Hankel Matrix of a 2-input— 2-output Bilinear Heat 
Exchanger Cell model 



As we have already seen in Section 4.4.4, the state-space model of a heat 
exchanger cell derived from first engineering principles is bilinear. We use 
this fact in this section to illustrate how to construct the Hankel matrix of a 
bilinear process system from its state-space representation. 

Consider the dynamic model of a simple heat exchanger: 



dT rn V r , . U A 

= -A(T ci - T co ) + (Tho - T co ) 

at V c c pc p c V c 

- Th °) + UA V ( T < ™ - T ho) 
at V h Cp h p h V h 

Let us introduce the following notations: 



k r = 



UA 



■ ; kh — 



UA 



CpcPcVc C-phPhVh 

X\ — T co , X2 — d\ 0 . Ui — U c , Il2 Vh 
Xi U\ 

, u = 

X2 U2 



X = 



(5.38) 

(5.39) 

(5.40) 

(5.41) 

(5.42) 



With the notations above, the model can be written in the standard form 



2 

x = Ax + Bu + NiXUi (5.43) 

i= 1 



where 
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A = 



h c k c 
kh ~k h 



B = 

m = 

n 2 = 



Tn 

V c 

0 



0 

T hi 

V h 



Vc U 

0 0 

0 0 




Furthermore, let us define the output of the system as 



y = 


2/i 


= Cx = 


T O' 




Xi 




_ 2/2 _ 




0 1 




_ x 2 _ 



(5.44) 

(5.45) 

(5.46) 

(5.47) 

(5.48) 

(5.49) 



Let us denote the column vectors of B by bi and b 2 , and the row vectors of 
C by Ci and c 2 respectively. 

Based on the notation above, the scalar elements in the upper-left corner 
of the Hankel matrix of the heat exchanger with the defined inputs and 
outputs can be written as 





0 


(0) 


(1) 


(2) 


0 


ClZo 


ci Ai’o 


ci(6i + NxXq) 


ci (b 2 + N 2 x o) 




C 2 x 0 


c 2 Ax 0 


c 2 (bi + NiXq) 


c 2 (b 2 + N 2 x o) 


(0) 


ciAxq 


C\A 2 Xq 


c\A{b\ + NiXq) 


ciA{b 2 + N 2 x o) 




c 2 Ax 0 


c 2 A 2 x o 


c 2 A(bi + NiXq) 


c 2 A(b 2 + N 2 x o) 


(1) 


ci(bi + Nxxo) 


c\N\Axq 


ciNi(bi + Nixo) 


c\Ni(b 2 + N 2 xq) 




c 2 (h + Nix 0 ) 


c 2 N,Ax 0 


C2Ni(h + Nix 0 ) 


c 2 N\ (b 2 + N 2 xq) 


(2) 


ci(b 2 + N 2 x 0 ) 


c\N 2 Ax 0 


c\N 2 {bi + NiXq) 


c\N 2 {b 2 + N 2 xq) 




c 2 (b 2 + N 2 x q) 


c 2 N 2 Ax o 


c 2 N 2 {bi + NiXq) 


c 2 N 2 (b 2 + N 2 xq) 



5.5 The Zero Dynamics 

The zero dynamics is an important concept that plays a role exactly similar 
to the zeros of the transfer function in a linear system. The notion of zero 
dynamics was introduced by Byrnes and Isidori [17]. Its application to the 
solution of critical problems of asymptotic stabilization was described in [18]. 

The abstract definition of zero dynamics for input-affine nonlinear systems 
is as follows. 

Definition 5.5.1 (Zero dynamics) 

Consider the system (3.19) with constraints y = 0, that is 



x = f(x) + J2iLl 9i( x ) u i 
0 = h(x) 



(5.50) 
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The constrained system (5.50) is called the zero-output constrained dynamics, 
or briefly, the zero dynamics. 



5.5.1 The Zero Dynamics of SISO Nonlinear Systems 

Before we turn to analyzing the zero dynamics of SISO nonlinear systems, 
we introduce the notion of relative degree below. 

Definition 5.5.2 (Relative degree) 

The single-input-single- output nonlinear system 

x = f(x)+g(x)u (5.51) 

y = h(x) (5.52) 

is said to have relative degree r at a point a; 0 if 

1. LgL^hfx) = 0 for all x in a neighborhood of x° and all k < r — 1. 

2. LgL^hix 0 ) ± 0 . 

The last condition is called a non-triviality condition. Note that there may 
be points where a relative degree cannot be defined. 

Note that the notion of relative degree will be extensively used later in Sec- 
tion 10.1 for designing nonlinear controllers using state feedback and input- 
output linearization. 

After a suitable coordinates transformation (see, e.g. [37]) z = T>(x) where 
Zi = <f>i(x) = L l f~ 1 h(x) for 1 < * < r and L g <j>i(x) = 0 for r + 1 < j < n, 
the state-space model (3.19) with m = 1, p = 1 and relative degree r can be 
rewritten as 

Zl = Z2 
Z2 = Z 3 



Zf — 2 . — Z'p 

z r = b(£, rf) + a(£,r))u 

V = q(Z,v) (5-53) 

where £ = [z 3 ... z r ] T , y = [z r+1 ... z n } T , a(£,??) = L g L r f 1 h($- 1 (£,ri)) 
and b(£,r]) = V))- 

Problem of Zeroing the Output. This problem is to find, if it exists, 
pairs consisting of an initial state x* and input function u defined for all t 
in a neighborhood of t = 0, such that the corresponding output y(t) of the 
system is identically zero for all t in a neighborhood of t = 0. For any fixed 
initial state x* , the input function u can be determined as follows. Let us set 
the output to be identically zero, then the system’s behavior is governed by 
the differential equation 
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f]{t) = q(0,r}(t)) 



(5.54) 



The dynamics (5.54) describes the internal behavior of the system when the 
output is forced to be zero. The initial state of the system must be set to a 
value such that £(0) = 0, while ?y( 0) = rf can be chosen arbitrarily. Further- 
more, the input must be set as 



u(t) 



a(0,?7(f)) 



(5.55) 



where 77 (f) denotes the solution of (5.54) with initial condition 77 ( 0 ) = 77 °. 

The investigation of the zero dynamics can be extremely useful when 
selecting the outputs to be controlled, since the stabilization of an output 
with globally asymptotically stable zero dynamics implies the global asymptotic 
stability of the closed-loop system. 

Motivated by the notions of linear systems’ theory, nonlinear systems 
with globally asymptotically stable zero dynamics are called minimum-phase 
systems. 



5.5.2 Example: The Zero Dynamics of Continuous Fermentation 
Processes 

The procedure of obtaining zero dynamics of a system will be illustrated 
in the example of a bio-reactor here. In order to analyze zero dynamics as 
is described in Section 5.5 before, we need to extend the original nonlinear 
two-dimensional state equation in Equations (4.78)— (4.79) with a nonlinear 
output equation 

y = h{x) (5.56) 

where y is the output variable and h is a given nonlinear function. Then the 
zero dynamics of an input-affine nonlinear system containing two state vari- 
ables can be analyzed using a suitable nonlinear coordinates transformation 
z = <P(x): 



Zi 




y 


_ z 2_ 




_X(x) 



(5.57) 



where \(x) is a solution of the following partial differential equation (PDE): 
L g X(x) = 0 (5.58) 

where L g X(x) = §£g( x), i.e. 



dX 

dxi 



9 1 + 



dX 

dx 2 



92 = 0 



(5.59) 
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In the case of the simple fermenter model in Equations (4.78)-(4.79), we can 
analytically solve the above equation to obtain 



A(ar) = F 



( V(-S f + x 2 + S 0 ) 
\ x\ + X 0 



(5.60) 



where F is an arbitrary continuously differentiable function. Then we can use 
the simplest possible coordinates transformation 2 = <P(x) in the following 
form: 



Zi 




y 


_ z 2_ 


— 


V(-S f +X2+So) 




tci+Xo 



(5.61) 



Selecting the Substrate Concentration as Output. If a linear function 
of the substrate concentration is chosen as output, i.e. 

zi = y = k s x 2 (5.62) 

where k s is an arbitrary positive constant, then the inverse transformation 
x = <P~ 1 (z ) is given by 



Xl 




' -z 2 X 0 ks-S f Vk s +Vz 1 +S 0 Vk s " 





Z2k s 


_ x 2_ 




z 1 
k s 



(5.63) 



Thus the zero dynamics in the transformed coordinates can be computed as 



; T u x dX . 
z 2 = X = L f X(x) = —x 



(5.64) 



which gives 



z 2 = LfX(x) + L g \{x)u = Lf\(x) = Lf\(<P x (^)) 



(5.65) 



since by construction L g X{x) = 0 (see Equation 5.59). The above equation is 
constrained by y = k s x 2 = Z\ = 0. Then the zero dynamics of the system is 
given by the differential equation 



z 2 = L f X(<p- 1 {0,z 2 )) 



( z 2 Y + V)Sofi max 

Y (K 2 + Sq + Sq + Ki) 



(5.66) 



which is linear and globally stable. The equilibrium state of the zero dynamics 
is at z 2 = — y, which together with z-i = 0 corresponds to the desired equi- 
librium state x\ = 0,x 2 = 0 in the original coordinates. The above analysis 
shows that if we manage to stabilize the substrate concentration either by a 
full state feedback or by an output feedback (partial state feedback) or even 
by a dynamic controller (which does not belong to the scope of this chapter) 
then the overall system will be stable. 
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Selecting the Biomass Concentration as Output. The output in this 
case is a linear function of the biomass concentration: 

z\ = y = k x xi (5.67) 

The zero dynamics of the system is given by: 

. = Vy max (zlYX 0 + z 2 (YVS f + VX 0 ) + S f V 2 )) 

" 2 (. K 2 Xgz$ + z 2 (2K 2 X 0 SfV + VX 0 ) + V 2 (K 2 S j + S f + Kf))Y 

(5.68) 

which describes a nonlinear dynamics and is only locally stable around the 
desired equilibrium state. The stability region can be determined by using 
the parameters of the system. 

The right-hand side of (5.68) is visible in Figure 5.2 using the parameter 
values of Table 4.1. It can be seen that the zero dynamics has two equilibrium 
points: the equilibrium point corresponding to the optimal operating point 
(z 2 = — V/Y = —8) is stable and the other one is unstable. 




Figure 5.2. The zero dynamics in the transformed coordinates: continuous bio- 
reactor, input: inlet feed flow rate, output: biomass concentration 



The results of the analysis of the zero dynamics show that the best choice 
of output to be controlled is the substrate concentration and involving the 
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biomass concentration into the output generally brings singular points into 
the zero dynamics and makes the stability region narrower. 



5.6 Further Reading 

An excellent introduction to the theory of linear systems including realization 
theory can be found in [20]. The Hankel matrix approach to linear systems 
is emphasized in [56] . The realization problem of time- varying linear systems 
is examined in, e.g. [62]. 

In [25], the Fliess series expansions are discussed in detail. The basic 
reference for the Volterra series expansion of nonlinear systems is [45]. The 
existence and the relationship between the minimal realizations of nonlinear 
systems are investigated in [71]. The properties and input-output descrip- 
tion of bilinear systems are studied in [16]. The theory of Hankel matrices 
for nonlinear systems is worked out in [24]. The problem of obtaining the 
time-domain input-output description of a nonlinear state- space model by 
eliminating the state variables is discussed in [79]. 



5.7 Summary 

The input-output representation forms of lumped parameter systems in both 
the LTI and the nonlinear input-affine cases are described. The nonlinear 
input-output models are introduced as generalizations of the LTI forms in the 
form of formal power series and higlrer-orcler nonlinear differential equations. 

The basic notions and main results of realization theory are also presented 
in both the LTI and the nonlinear input-affine cases., where one has to find a 
state-space model for a given input-output representation. Special emphasis 
has been put on certain system invariants: to Markov parameters and to 
Hankel matrices. 

The notion of zero dynamics is also introduced in this chapter and it is 
illustrated in the example of a continuous fermentation process. 



5.8 Questions and Application Exercises 

Exercise 5.8.1. A continuous time LTI system is given with the following 
state-space representation: 





'-1 2' 




'1' 


X = 


1 0 


x + 


0 



y=[l2]x 

with the initial condition a:(0) = 
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1. Give the transfer function of the system. Is the transfer function unique? 

2. Is the state-space representation unique? 

3. Compute the impulse-response function of the system. 

4. Compute the response of the system (y) for the unit step input. 

Exercise 5.8.2. A system is described by the following input-output model: 

2/2 = u 3 

V3 + yi = u 2 

2/3 + 2 yi - 2/3 = 8 u 2 - 2ui + u 3 + 4u 4 
2yi +y3 + V 2 = u 4 - u _ l 

1. Give a possible state-space representation of the system. 

2. Is the system linear and time-invariant? Why? 

3. How many inputs, outputs, states has the system? 

4. Is this state-space representation unique? Why? 

Exercise 5.8.3. Show that the nonlinear state-space model 

X\ = x\x 2 + u 
x 2 = —xi + ln(a:2) 
y = x 2, x 2 > 0 

is a realization of the input-output model 

y - 2/2/ = (M 2 /) - y) 3 y 2 + uy, y>0 

Exercise 5.8.4. Examine the stability of the zero dynamics of the following 
system: 

Xi = 2x\ — x\ 
x 2 = — x\ — Xi 
y = xi 

Is any coordinates transformation needed for this? 

Exercise 5.8.5. Calculate the terms in the Fliess series of the system in 
Exercise 5.8.4 for x(O) = [0 0] T up to k = 2. 

Exercise 5.8.6. Determine the upper 3x3 part of the Hankel matrix of the 
system in Exercise 5.8.4 for a;(0) = [0 0] T . 
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Controllability and observability play a fundamental role in designing con- 
trollers for both linear and nonlinear systems. This chapter is devoted to the 
basic as well as to the advanced material on controllability and observability 
presented in the following sections: 

• Controllability and observability of LTI systems 

This section summarizes the basic notions of controllability and observ- 
ability in the example of the most simple linear time-invariant system. 

• Local controllability and observability of nonlinear systems 

The controllability and observability notions are extended here to the case 
of the input-affine nonlinear system. 

• Controllability and observability of nonlinear process systems 

The local controllability and observability analysis is specialized in this 
section to the case of the nonlinear process system with no source. 

• Process system examples and case studies 

Complete case studies illustrate the use of linear and nonlinear controllabil- 
ity and observability analysis methods on different heat exchanger models 
and on continuous and fed-batch fermenter models. 



6.1 Controllability and Observability of LTI Systems 

This section is devoted to the basic reference case, to the controllability and 
observability analysis of LTI systems, which will be extended to the nonlinear 
case later in this chapter. 

Given an LTI system with finite dimensional representations in the form 

x = Ax + Bu . 

y = Cx < 61 > 

It is important to observe that the above general form of the state-space rep- 
resentation used for the controllability and observability analysis is a special 
case of the one in Chapter 3 in Equation (3.1) with D = 0. The reason for 
this simplification is that one always can transform the more general form in 
Equation (3.1) into Equation (6.1) by appropriate re-scaling (centering) of 
the input and output variables. 




98 



6. Controllability and Observability 



Thus a state-space representation will be characterized by the triplet 
(A, B, C ) in this section. The following dynamical properties of state-space 
representations of LTI systems are described here: 

1. Observability. 

2. Controllability. 



6.1.1 State Observability 

In order to understand the problem statement of state observability, we need 
to recall from Chapter 2 that only the input and output variables of a system 
are directly observable (measurable) and not its state variables. 

Definition 6.1.1 (State observability) 

Given the inputs and the outputs of a system over a finite time interval. If 
it is possible to determine the value of the states based on these values and a 
state-space system model in such a way that we use functions of inputs and 
outputs and their derivatives, then the system is called (state) observable. 

In the case of LTI systems, the above general definition specializes to the one 
below. 

Definition 6.1.2 (LTI state observability) 

Given a state-space model by its realization matrices ( A , B , C) and the mea- 
sured input and output signals 

{ u(t), y(t) | t 0 <t<t, F } 

The system is state observable if we can determine the state signal x at a 
given time to, i.e. x(to). 

The following theorem gives necessary and sufficient condition for a state- 
space representation of an LTI system to be state observable: 

Theorem 6.1.1 (LTI state observability). Given a state-space model of 
a LTI system by its realization matrices ( A,B,C ). This state-space model is 
state observable if and only if the observability matrix O n is of full rank 

C 

CA 



CA n ~ x 



where dim x = n, i.e. rank O n = n. 
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It is important to emphasize that the observability matrix depends on the 
realization , and it may change if one applies state transformation to a state- 
space representation (A,B,C). This holds because the observability matrix 
O n depends only on the pair ( A , C) in a way that is not invariant under state 
transformation. At the same time, the rank of the observability matrix O n 
remains unchanged. 



6.1.2 State Controllability 

As its name suggests, state controllability is a necessary dynamic property of 
a system to be controllable in the entire state-space. 

Definition 6.1.3 (State controllability) 

A state-space model of a system is called state controllable if it is possible to 
drive any state x(t\) to any other state xfa) yf x{t,\) with an appropriate 
input in finite t = t2 — f i time. 

In the LTI case, the above definition specializes to the one below. 

Definition 6.1.4 (LTI state controllability) 

A state-space model of an LTI system given by its realization matrices 
( A,B,C ) is called state controllable if it is possible to drive any state x(t i) 
to any other state xfo) x{t\) with an appropriate input in finite t = t2 — ti 
time. 

The following theorem establishes necessary and sufficient condition of an 
LTI system to be state controllable in terms of its controllability matrix. 

Theorem 6.1.2. A state-space model of an LTI system with realization ma- 
trices (A, B , C ) is state controllable if and only if the controllability matrix 

C n = [B AB A 2 B . . A n ~ 1 B] 

is of full rank, that, is rank C n = n. 

Again, it is important to emphasize that the controllability matrix depends 
on the realization , and it may change if one applies state transformation to 
a state-space representation (A, B,C). This holds because the controllability 
matrix C n depends only on the pair (A, B) in a way that is not invariant 
under state transformation. However, the rank of the controllability matrix 
C n remains unchanged. 

The following simple example illustrates the notions and tools introduced 
above: 
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Example 6.1.1 (LTI controllability and observability) 

Observability and controllability of a simple LTI state-space model 



Investigate the controllability and observability of the following 
continuous time LTI MIMO system: 



x = 



-5 -2 
2 1 



3 2-4 
10 6 

r 4 1 




u 



x 



The MIMO system has the following controllability matrix: 



C=[B AB 



3 2-4 -17 -10 8 
1 0 6 7 4 -2 ’ 



with rank C = 2 = n, therefore the system is controllable. 
The observability matrix 



O = 



C 

CA 



4 1 

-3 0 
-18 -7 
15 6 



has rank O = 2 = n, so the system is observable. 



6.1.3 Conditions for Joint Controllability and Observability 

We recall that both the controllability and observability matrix changes if 
we apply state transformation to a given realization. This section will show 
that joint controllability and observability is a system property, that is, it is 
realization-independent. 

Equivalent necessary and sufficient conditions will be given for an LTI 
system to be jointly controllable and observable. This will lead to the notion 
of minimal realization that will play an important role for nonlinear systems 
as well. 

Joint Controllability and Observability is a System Property. The 

main result in this subsection uses the notion and properties of Hankel ma- 
trices introduced in Section 5.3.1. 

The following lemma states that joint controllability and observability re- 
mains unchanged if a state transformation is applied, therefore it is a 
realization-independent property for LTI systems: 

Lemma 6.1.1. If we have an n-th order realization ( A,B,C ) of an LTI sys- 
tem with transfer function H(s) = which is controllable and observable, 
then all other n-th order realizations are controllable and observable. 
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The proof uses the fact that one can construct a Hankel matrix from the 
observability and controllability matrices 

C 

CA 

0(C, A) = ' , C(A,B) = [B AB A 2 B . . . A n ~ 1 B] 

CA n ~ l 

where 0(C, A) is a column block-matrix and C{A , B ) is a row block-matrix. 
With the matrices above 

H[l,n-l} = 0(C,A)C(A,B) (6.2) 

The Irreducibility of the Transfer Function. An equivalent (that is 
necessary and sufficient) condition for an LTI system to be jointly controllable 
and observable is to have its transfer function to be irreducible. 

Definition 6.1.5 (Irreducible transfer function) 

The transfer function 




is called irreducible if the polynomials a(s ) and b(s) are relative primes, that 
is, they have no common factors (no common roots). 

Theorem 6.1.3. H(s) = is irreducible if and only if all n-th order 
realizations are jointly controllable and observable. 

Minimal Realizations. The second equivalent condition to joint control- 
lability and observability uses the notion of minimal realizations. 

Definition 6.1.6 (Minimal realization) 

A realization (A, B, C ) of an LTI system of dimension dim x = n is minimal 
if one cannot find another realization of dimension less than n. 

With this notion we can state an equivalence between minimality of a real- 
ization and irreducibility of the transfer function of the system. 

Theorem 6.1.4. H{s ) = is irreducible if and only if any of its realiza- 
tions (A, B, C) are minimal where 

H(s) = C(sl — A)~ 1 B 

Using Theorem 6.1.3, we can now state the equivalence between minimality 
of a realization and joint controllability and observability of a system. 

Theorem 6.1.5. A realization (A, B , C) is minimal if and only if the system 
is jointly controllable and observable. 
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It is important to note that minimal realizations are not unique, that is, we 
can find infinitely many minimal realizations which are related. 

Lemma 6.1.2. Any two minimal realizations can be connected by a unique 
similarity transformation (which is invertible). 

Let the two minimal realizations be (A\,B\,Ci) and (A 2 , B 2 , C 2 ). Minimal 
realizations are jointly controllable and observable, therefore the matrix 

T = 0~ 1 (C 1 ,A 1 )0(C 2 ,A 2 ) = C(A 1 ,B 1 )C~ 1 (A 2 ,B 2 ) (6.3) 



exists and it is invertible. 

Remember that any invertible similarity transformation T will produce 
another realization (A, B, C) from the given realization (A, B , C) of the same 
system with the same transfer function, thus T serves as the transformation 
matrix between the two realizations. 

The following simple example illustrates the investigation of joint control- 
lability and observability of LTI systems: 



Example 6.1.2 (LTI joint controllability and observability) 

Joint controllability and observability of a simple LTI system 

Let the simple LTI system be described by the following input- 
output model: 

2 y'" + 8 y" + 2 y' - 12 y = 4u + 2 u' 

Investigate joint controllability and observability of this system 
and give a state-space realization. 

Applying Laplace transformation, we get 
(2s 3 + 8s 2 + 2s - 12)F(s) = (4 + 2s)U(s) 

• From this, the transfer function can be computed: 

H(s ) = Kifl= 2s + 4 = 5 + 2 

U (s) 2s 3 + 8s 2 + 2s — 12 s 3 + 4s 2 + s — 6 

• The root of the enumerator (si = —2) is also a root of the de- 
nominator, so the transfer function is not irreducible. Therefore 
the system is not jointly controllable and observable. 
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• By using the controller form realization (see in Subsection 
3.2.3), we can easily determine a state-space representation: 





r_4 -i 6i 




'1' 


X = 


i 


0 0 


x + 


0 




0 


1 0 




0 



y = 0 12 x 



6.1.4 General Decomposition Theorem 

If we have a representation (A, B,C), then we can always find an invert- 
ible similarity transformation which moves the system to another realization 
(A, B, C) with the partitioned state vector 

X T X co X c o Xq 0 Xqq 1 



and partitioned matrices 





Aco 0 ^13 0 




B co 


T = 


A 2 i A C o A 2 3 A 2 4 


B = 


Bco 




0 0 Aco 0 




0 




0 0 A 43 A^ 




0 



c= [C co OC 5 o o; 



(6.4) 



The partitioning above defines subsystems of the original system which 
are as follows: 

Controllable and Observable Subsystem. The realization of the jointly 
controllable and observable subsystem is given by the matrices A co , B co , C co . 
The realization (A co , B co , C co ) is minimal, i.e. n < n and 



C(sl - A)~ 1 B = C(sl - A)~ l B 



Controllable Subsystem. Its realization is 



f A co 0 
V _^21 A C o _ 



B C o 

Bco 




Observable Subsystem. Its realization is 



f A co Ais 

\[ 0 A So J’ 



Bco 
0 ’ 




(6.5) 



( 6 . 6 ) 



(6.7) 
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Uncontrollable and Unobservable Subsystem. Its realization is 

(PW], [0], [0]) (6.8) 

6.2 Local Controllability and Observability of Nonlinear 
Systems 

This section is devoted to the extension of controllability and observability 
to the class of input-affine nonlinear systems given by a state-space represen- 
tation in the form 

m 

x = /( x) + g(x)u = f(x) + ^2 gi{x)ui (6.9) 

i— 1 

Vj = hj(x), j = l,...,p (6.10) 

6.2.1 The Controllability Distribution, Controllable Nonlinear 
Systems 

In the case of nonlinear systems, the set of states that are reachable from a 
given initial state are characterized using distributions (see Section A. 4.1 in 
the Appendix). 

The first results presented here are generalizations of the General Decom- 
position Theorem above. Their complete derivation can be found in [37]. 

Lemma 6.2.1. Let A be a nonsingular involutive distribution of dimension 
d and suppose that A is invariant under the vector field f in Equation (6.9). 
Then at each point x° there exist a neighborhood U° of x° and a coordi- 
nates transformation z = <L>(x ) defined on U°, in which the vector field f is 
represented by a vector of the form 

fi(zi,...,z d ,z d+1 ,...,z n ) 

fd(z l_j * ' ‘ 5 Z d j Z d +1, • • • , Z n ) 
fd+ l(z d +l, ■ ■ ■ , Z n ) 

fn{z d +l j • ■ • j Zn) 

It is not difficult to prove that the last n — d coordinate functions of the 
local coordinates transformation z = <P(x) in the neighborhood of x° can be 
calculated from the following equality: 

span{d$ d+:L , . . . , d<P n } = A 1 - (6-12) 

while the first d coordinate functions should be chosen so that d? is locally 
invertible around x° {i.e. the Jacobian of <P evaluated at x° should be non- 
singular) . 

Now we can use the above Lemma to state the main result. 



( 6 . 11 ) 
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Proposition 6.2.1. Let A be a nonsingular involutive distribution of dimen- 
sion d and assume that A is invariant under the vector fields f , gi, ■ ■ ■ , g m 
in Equation (6.9). Moreover, suppose that the distribution spanjgi, . . . ,g m } 
is contained in A. Then, for each point x° it is possible to find a neighbor- 
hood U° of x° and a local coordinate transformation z = <b(x) defined on U° 
such that, in the new coordinates, the system (6.9)-(6.10) is represented by 
equations of the form 

m 

Ci = /i (Ci » C 2 ) + y~lffn(Ci)C 2 )n» 

i—1 

C 2 = $2 (C 2 ) 

Vi = ^i(Cl) C 2 ) 

where Ci = (zi, ■ ■■,z d ) and C 2 = (z d + 1 , • • -,z n ). 

The above proposition (which presents a coordinate-dependent nonlinear ana- 
log of the controllability part of the general decomposition theorem for LTI 
systems) is very useful for understanding the input-state behavior of nonlin- 
ear systems. 

Supposing that the assumptions of Proposition 6.2.1 are satisfied, choose 
a point x° and set a;(0) = x°. For small values of t, the state remains in 
U° and we can use Equations (6.13)-(6.15) to interpret the behavior of the 
system. From these, we can see that the C 2 coordinates of x(t) are not affected 
by the input. If we denote by x°(T ) the point of U° reached at time t = T 
then it’s clear that the set of points that can be reached at time T, starting 
from x°, is a set of points whose C 2 coordinates are necessarily equal to the 
C 2 coordinates of x°(T). Roughly speaking, if we can find an appropriate 
A distribution and the local coordinates transformation z = <?( x ) then we 
can clearly identify the part of the system that behaves independently of the 
input in a neighborhood of x°. 

It is also important to note that if the dimension of A is equal to n then 
the dimension of the vector C 2 is 0, which means that the input affects all 
the state variables in a neighborhood of x° (the system is reachable in a 
neighborhood of a; 0 ). 

On the basis of Proposition 6.2.1 and the above explanation, the first 
step towards the analysis of local reachability of nonlinear systems is to find 
a distribution A c that characterizes the controllability (reachability) of an 
input-affine nonlinear system. 

Definition 6.2.1 (Controllability distribution) 

A distribution A c is called the controllability distribution of an input-affine 
nonlinear system if it possesses the following properties. It 

1. is involutive, i.e. 



(6.13) 

(6.14) 

(6.15) 



V(ti,t 2 e A c ) 



> [ti,t 2 ] e A, 
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2. is invariant under the vector fields (/ = go , ( gt , i = 1, . . . , m)), i.e. 

V(r € A c ) => \gi,T]eA c 

3. contains the distribution spanjgi, . . . , g m } 

A 0 = span{ gi , . . . , g m } C A c 

4- is “minimal” (If V is a family of distributions on U, the smallest or 
minimal element is defined as the member of V (if it exists) which is 
contained in every other element ofV) with the above properties. 

Lemma 6.2.2. Let A be a given smooth distribution and Ti, . . . ,r q a given 
set of vector fields. The family of all distributions which are invariant under 
ri , . . . , T q and contain A has a minimal element, which is a smooth distribu- 
tion. 

One can use the nonlinear analogue of the ^4-invariant subspace algorithm to 
construct the controllability distribution A c . 

Let us introduce the following notation. The smallest distribution that 
contains A and is invariant under the vector fields go, ... , g m will be denoted 
by (go,...,g m \A). 

Isidori [37] proposes an algorithm for constructing the controllability dis- 
tribution as follows: 

Algorithm for Constructing the Controllability Distribution. 

1. Starting point 

A 0 = span{gi , . . . , g m } (6.16) 

2. Development of the controllability distribution 

m 

Ak = Ak-i + ^^[gi, Ak-i] (6-17) 

i=0 

Note that one term in the last sum [gi,Ak-i\ is computed by using the 
functions (<j> i, . . . spanning the distribution Ak~i'. 

[gi, A k - 1] = span{[5j, fix [g i; fa]} 

It is proved that A k has the property 

Ak C (go, ■ ■ ■ i gm | Af) 

3. Stopping condition 

If 3k* such that Ak * = Ak*+ 1 , then 



A c — Ak * — (go , ■ ■ • , gm \ Ao) 
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Properties of the Algorithm. The algorithm above exhibits some inter- 
esting properties. It starts with the distribution spanned by the input func- 
tions (Ji{x) of the original state equation. Thereafter it is necessary to compute 
the Lie-brackets (i.e. [f(x),gi(x)]) of the functions f(x) and gi(x) respec- 
tively. Then we expand the distribution obtained in the previous step by the 
distribution spanned by the Lie-brackets, i.e. (\f(x), g%(x)\, i = 1, . . . , mfc). 

Simple Examples. We start with the example of computing the controlla- 
bility distribution of LTI systems, which highlights the connection between 
the A-invariant subspace algorithm and the algorithm for constructing the 
nonlinear controllability distribution. 



Example 6.2.1 (LTI controllability distribution) 

Controllability distribution of LTI systems 

The above concepts of constructing the controllability distribution 
are complete analogues of the linear system concepts (infimal A- 
invariant subspaces). To see this, consider the linear system: 

x = Ax + Bu , u € R m , iel" (6.18) 

y = Cx (6.19) 

Let us construct the smallest A-invariant subspace over Im B. 
Let 

A 0 = Im B = spanjfo!, . . . , b m } 
where bi is the i-tli column of matrix B and 

f(x) = g 0 {x) = Ax 

at each x £ R ra . Any vector field of Aq can be expressed as 

m 

9{x) = y ^Cj(x)bj 
»= i 

Then the above algorithm for constructing the controllability dis- 
tribution works as follows: 

Aq = span{6i, . . . , b m } 

Using the algorithm for A j,: 

m 

Ai = A 0 + A 0 ] = span {b u . . . ,b m , [f, b i], . . . , [/, b m \} 

i = 0 
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since 

\di 5 9j ] — bj\ — Lbibj L\ )j bi — 0 

Therefore with 

[f,bi\(x) = [Ax, bi] = Ax - ^g^ bi = ~Ab z , i=l,...,m 

we obtain that 

A x = lm[B\AB] 

Similarly: 

A k = Im [B\AB\...\A k B] 



The following simple example illustrates the computation of the controllabil- 
ity distribution in a two-dimensional case. 



Example 6.2.2 (Controllability distribution) 

Controllability distribution of a simple two-dimensional system 



Given a simple input-affine nonlinear system model in the form: 
1 _ 

xi = —xie x i + 3e X2 — x\u 
1 _ 

X 2 = bxie x i — X 2 u (6.20) 

y = -X2 



First we extract the functions f and g from the system model 
above: 



f(xi,x 2 ) 



-x\e *1 + 3e X2 

1 _ 

5xie “i 



g(xi,x 2 ) 




There are only two steps needed for computing the controllability 
distributions as follows: 



A 0 = span{ g }, Zii = span{ g, [ f,g } } 




6.2 Local Controllability and Observability of Nonlinear Systems 109 



where [/. <j\ is the Lie-product of / and g : 



l/,!7]W = g/W-g9(x) 



-1 0 
0 -1 



— aqe x i + 3e X2 

1 _ 

5aqe x i 



-(2^±i)e _5 r 3e X2 






0 



-Xi 

~X 2 



—e x i + 3 (x2 — l)e X2 

[L 

5aqe x i 



Thus the controllability distribution is 
A(x) = Ai(x) = span 



~Xi 

-x 2 



-e x i + 3{x 2 - l)e X2 

1 _ 

5aqe x i 



Obtaining the Transformed System. The locally transformed (decom- 
posed) system (6.13)-(6.15) can be calculated by performing the so-called 
total integration of the controllability distribution. The total integration basi- 
cally means the solution of the set of quasi-linear partial differential equations 
(see (6.12)). 

(fi(x) ••• fd(x)) = 0 (6.21) 

for obtaining the functions A j, j = 1 , . . . ,n — d, where the distribution to 
be integrated is spanned by the vector fields fi,- - ■ ,fd and /,; : K n i— > R” for 
i = 1, . . . ,n, d < n and the n — d A functions are linearly independent. 

According to the famous Frobenius theorem (see e.g. [37], Chapter 1), this 
problem is solvable if and only if the nonsingular distribution to be integrated 
is involutive. Note that the controllability distribution is always involutive by 
construction. 

After solving the n — d partial differential equations we can define the 
local coordinates transformation <P by using the solution A j, j = 1, . . . , n — d 
as follows. Set the last n— d coordinate functions of as 

4>d+l{x) = Xl{x), . . . , 4> n (x) = A n-d(x) (6.22) 

Then, choose the first d coordinate functions from the coordinate functions 
of the identical mapping 

xi(x) = xi, x 2 {x) = x 2 , ■ ■ ■ , x n (x) = x n (6.23) 

such that the Jacobian of d> is nonsingular (i.e. it is at least locally invertible) 
in the region of the state-space which is of interest. 

An example of calculating the coordinate transformation <P and totally 
integrating the controllability distribution of a nonlinear process system can 
be found later in Section 6.6. 
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6.2.2 The Observability Co-distribution, Observable Nonlinear 
Systems 

Roughly speaking, the problem statement of observability in the nonlinear 
case is the following. Under what conditions can we distinguish the initial 
states of an input-affine nonlinear system described by Equations (6.9)-(6.10) 
by observing its outputs? We will examine this property locally, similarly 
to local controllability. For this, we need the definition of indistinguishable 
states and observability. The notations and results presented in this section 
are based on [21] and [37]. 

Let us denote the output of the system model (6.9)-(6.10) for input u and 
initial state x(0) = £o by y(t,0,Xo,u). 

Definition 6.2.2 (Indistinguishable states, observable system) 

Two states X\,X 2 € X are called indistinguishable (denoted by X 1 IX 2 ) for 
(6.9)-(6.10) if for every admissible input function u the output functions 
1 1 — > y(t, 0, x± ,u) and 1 1 — > y(t , 0, X 2 ,u), t > 0 are identical. 

The system is called observable if x\Ix 2 implies x\ = X 2 - 

The local versions of the above properties are the following: 

Definition 6.2.3 (V-indistinguishable states, local observability) 

Let V C X be an open set and Xi,X 2 € V. The states x\ and X 2 are said to 
be V-indistinguishable (denoted by X\I V X 2 ), if for every admissible constant 
control u with the solutions x(t, 0, X\,u) and x(t, 0, X 2 ,u) remaining in V for 
t < T, the output functions y(t,0, X\, u) and y(t,0,X2,u) are the same for 
t < T. 

The system (3.19) is called locally observable at xq if there exists a neigh- 
borhood W of xq such that for every neighborhood V € W of xq the relation 
xo /' x\ implies X\ = Xq. If the system is locally observable at each Xq then it 
is called locally observable. 

Definition 6.2.4 (Observation space) 

The observation space O of the system (3.19) is the linear space of functions 
on X containing hi, ... , h p and all repeated Lie-derivatives 

l ■ - 1 L T2 . . . L Tk hj , j I? • • • , Pi h 1,2,... (6.24) 

where n G {go,9i, ■ ■ -,9m}, i = l,...,k. 

We remark that the observation space has the interpretation that it contains 
the output functions and all of their derivatives along the system trajectories. 
The following theorem gives a sufficient condition for local observability. 

Theorem 6.2.1. Consider the system (3.19) with dimT = n and assume 
that, dim dO(xo) = n where 

dO{x) = sp&n{dH(x) \ H G O}, x G X 

Then the system is locally observable at xq. 
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Based on this, it’s useful to define the so-called observability co-distribution. 

Definition 6.2.5 (Observability co-distribution) 

The observability co-distribution dO of an input-affine nonlinear system with 
observation space O is defined as follows: 

dO{x) = span{dff(;r) | H € O}, x € X (6.25) 

The rank of the observability co-distribution can be determined using the 
dual version of the algorithm that was used for generating the controllability 
distribution. 

Let us denote the smallest co-distribution which contains 
17 = span{d/i,i , . . . , dh p } 

and is invariant under g 0 , . . . ,g m by (g 0 , ■ ■ ■ , g m \^)- 

Algorithm for Constructing the Observability Co-distribution. 

1. Starting point 

l7o = span{d/ii, . . . , dh p } 

2. Developing the observability co- distribution 

m 

17 k — I7fc-i -I - 'y ' L pi I7fc_i 
i= o 



3. Stopping criterion 

If there exists an integer k* such that 17^* = 17fc* + i, then 

17 0 = 17 k* = {goi • • • . dm |I7o) 

The dimension of the nonsingular co-distribution 17*.» at Xq is equal to the 
dimension of the observability co-distribution at Xq. 

If the dimension of the observability co-distribution is strictly less than 
n, then we can find a local coordinates transformation which shows the un- 
observable nonlinear combinations of the state variables, as is stated by the 
following proposition: 

Proposition 6.2.2. Let A be a nonsingular involutive distribution of dimen- 
sion d and assume that A is invariant under the vector fields /, g\, . . . ,g m . 
Moreover, suppose that the co- distribution span{d/i l7 . . . , dh p } is contained in 
the co- distribution A 1 - . Then, for each point xq it is possible to find a neigh- 
borhood U° of x° and a local coordinates transformation z = <P(x) defined on 
U° such that the system (6.9)-(6.10) is represented as 
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Ci — /i(Ci,C2) + E^(Ci^2K (6.26) 

i = 1 
m 

C 2 = /2 (C 2 ) + y ^2,92i{.C,2)Ui (6.27) 

i=l 

2/, = hi{ Ca) (6.28) 

where Ci = ( 21 , ■■■,z d ) and ( 2 = (^+ 1 , ■ • . , 2 „) 

It is evident from Equations (6.26)-(6.28) that the output depends only on 
(( 2 , and (2 is independent of £ 1 . Therefore, starting from a fixed initial value 
of (2 and from arbitrary initial values of ((1 and for arbitrary input u, the 
system produces exactly the same output and therefore it cannot be locally 
observable (see Definition 6.2.3). 

It is important to note the duality and similarity between the algorithms 
generating a controllability distribution and the observability co-distribution. 

Simple Examples. The following example shows the use of the algorithm 
of generating the observability co-distribution. 



Example 6.2.3 (Observability co-distribution) 

Consider again the system in Example 6.2.2 and let us calculate its 
observability co-distribution. The starting point of the algorithm 
is 

f2 0 (x) = span{d/i(x)} = span{[0 — 1]} (6.29) 

The Lie-product of u> = dh along / according to the definition is 

T ( \ fT ( \ ( 9 uj t \ T df Jn + 1) i n 

LfU{x) = f (x) +w(x)— = -5 e*i 0 

\ LUX J OX [ V X\ ) 

(6.30) 

and 



L g oj(x) = [0 1] 



(6.31) 
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Therefore the observability co-distribution after one step is given 

by 



1? i(x) = span 



[o-i], 




Xi + 1 
Xi 



1 

e x i 




(6.32) 



from which we can see that the system satisfies local observability 
conditions at almost all points of the state-space. 



In order to highlight the connection between linear and nonlinear observabil- 
ity, we construct the observability co-distribution of LTI systems in the next 
example. 



Example 6.2.4 (LTI observability co-distribution) 

Observability co- distribution of LTI systems 

Consider the linear system 

x = Ax 
y = Cx 
Then 

Oo(x) = spanjci, . . . , c p } (6.33) 

t(x) = Ax (6.34) 

where Ci, ... ,c p denote the rows of C. The first step of the algo- 
rithm is 



17 1 = l?o + L t I2q = spanjci, . . . , c p , L T c \ , . . . , L T c p } (6.35) 



Since 



L T Ci( x) 



LAxCi 



= Ci 



d{Ax) 

dx 



= ciA 



we have 



(6.36) 



f2i(x) = spanjci, . . . , c p , C\A , . . . , c p A} (6.37) 

Continuing in the same way, we have, for any k > 1, 

L2 k (x) = span{ci, . . . ,c p ,ciA, . . . ,c p A , . . . ,ciA k , . . . , c p A k } 

(6.38) 
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By duality, is the largest distribution invariant under the 

vector field Ax and contained in the distribution Of . Note that 
at each x € R ra , 

Of (x) = ker(C) (6.39) 



^n- lO) = kGr 



c 

CA 



CA "- 1 



(6.40) 



We are interested in the dimension of J7^_ 1 (x) (which is indepen- 
dent of x). If the observability matrix is of full rank (n), then the 
dimension ( d ) of Of_ x (x) is 0, which means that the system is 
state observable. 



6.2.3 The Minimal Realization of Nonlinear Systems 

The solution to the problem of identifying the minimal realizations of a non- 
linear system is similar to the linear case. 

Theorem 6.2.2 (The minimal realization of nonlinear systems). A 

realization {<?oi <7i ; • • • > 9m, h, x 0 } of a formal power series c is minimal if 
and only if the realization satisfies the controllability rank condition and the 
observability rank condition at x° . 



6.3 Controllability and Observability of Nonlinear 
Process Systems 

If one performs controllability analysis of process systems, the specialities of 
process system models should be taken into account. For this purpose the 
decomposed form of the general state equation (4.15) in Section 4.2.3 serves 
as a starting point. The nonlinear functions on the right-hand side of the 
input-affine state equations take the following special form: 

/( X) = AtransferX + Q^\x) (6-41) 

g i (x)=N i x + B^ nv (6.42) 

where Bconv is the 1-th column of the matrix B conv . 

We recall that the Lie-bracket is a multi-linear function of both of its argu- 
ments, therefore any of the components of the algorithm for constructing the 
controllability distribution has the following decomposition: 
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A 0 = span{!Via; + Bclhv, ■ ■ ■ ) N m% "I” B CO nv } 

Ai = A 0 + XI™ 1 span{ (NiA tra nsf er At rans f er Ni)x 



(6.43) 



— At ra nsferBconv+[Q)fi > (x)iNiX\+ 1 (x) , Bconv } 



•>(j) 



'l(j) I 



>conv 



+ YZi IXi span{(iVfciVj - N t N k )x - TV;B^L + TV fc 4L,] 



The above decomposition shows that the controllability property is super- 
additive with respect to the mechanisms present in the terms of the con- 
servation balance such as input and output convection, transfer and sources 
(including chemical reactions). This means that two mechanisms both lack- 
ing controllability may interact to produce that property in the nonlinear case 
[82]. 



6.3.1 Process Systems with no Source: the Linear-bilinear 
Time-invariant Case 



In this special but still interesting case, there are no sources present in the 
system. Therefore the nonlinear functions of the general state equation in 
Equation (4.15) take the following decomposed special form: 

/l(^) = At rans f er x (6.44) 

g i (x) = N i x + Bit v ( 6 - 45 ) 



Observe that the state function is now linear and time-invariant and the input 
function remains bilinear-linear and time- invariant. 

In this case the algorithm described above in Equation (6.43) for con- 
structing the controllability distribution A c is more simple because of the 
lack of the general nonlinear term and goes as follows: 



A 0 = span{AT 1 a: + B$ nv , ■ • ■ , N m x + B y c 
Ai = Aq 

d~ l Spall { (At; Afransfer Af ra nsferNi)x A t.ransferB C onv\ 

+ i E3T=i span {(N k Ni - TV; N k )x - nMoL + N k B$ nv } 



>( m ) 

■> conv 



} 



(6.46) 



(6.47) 



One can easily recognize the presence of the Kalman controllability matrix 
as an additive constant term in the vectors 



A-transfer-^ ; ^ 1, ... , 77,, i 1, . . . , 777- 



6.4 Heat Exchanger Examples 

As we have seen earlier in Section 4.4, heat exchangers are one of the most 
simple yet important operating units in process systems. Depending on the 
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modeling assumptions, heat exchangers may have LTI, LTV, LPV or input- 
affine bilinear state-space models, and thus they are ideal simple examples to 
carry out and compare linear and nonlinear controllability and observability 
analysis. 



6.4.1 Local Controllability and Observability of an LTI Heat 
Exchanger Cell Model 



As the most simple case, we start with the LTI state-space model of the heat 
exchanger cell developed in Section 4.4.2. It is relatively easy to construct the 
controllability distribution and the observability co-distribution of the heat 
exchanger cell in this case as follows: 



• Controllability distribution 
The initial distribution 



A) = span { 51 , 52 } = span} 




0 

Vh 



} 



L v h J 



(6.48) 



spans the whole R 2 , since its elements are constant non-zero functions 
that are linearly independent in any point. This means that the system is 
controllable by inlet temperatures at any point of the state-space. 

• Observability co- distribution 

The initial co-distribution is given by the row vectors of the matrix C. 



J?o = span{ [1 0] , [0 1] } 



(6.49) 



Its rank is always 2 so the system is observable at any point. 



6.4.2 Local Controllability and Observability of a Nonlinear Heat 
Exchanger Cell 

Next we consider the bilinear (nonlinear) input-affine state-space model of 
the heat exchanger cell developed in Section 4.4.4. 

Now we need to use the algorithms above in Sections 6.2.1 and 6.2.2 
for constructing the controllability distribution and the observability co- 
distribution of the nonlinear heat exchanger cell. 

• Controllability distribution 

According to Equation (6.16) we can simply write the initial distribution 
Z\o as 



A)( x) = span{5i(x),5 2 (a:)} = span{ 



Tci — —Xl 
v„ V c Xl 




0 


7 



Thi 1 ™ 

VT ~ V*® 2 - 



(6.50) 
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We can see from (6.50) that the subspace spanned by the functions g i and 
c /2 is two-dimensional for almost any x\, X 2 ■ The dimension only decreases 
to zero when T C i = x± and Thi = X 2 ( i.e . the corresponding input and 
output temperatures are equal). This can happen if the cold and hot inlet 
temperatures are equal for a long time and thus there is no heat exchange 
in the operating unit, which is rarely the case in practice. 

In the next step we compute the distribution A\. 



Z\i = A 0 + span{[/, 5 i] , [f,g 2 ], [ 31 , 52 ]} 
First, we have to determine [f,g 1 ]. 

[f(x),gi(x)] = ^-/(x) - |^3i(x) 



dgi ,, , 

to' f{x) = 

df , x 
Tx 9l{x) = 



W°1 


— k\X\ + k\X 2 




-^(-kixi + k\x 2 ) 


0 °. 


k 2 x\ — k 2 x 2 




0 



k\ k\ 
k 2 —k2 



-| 








Uc v c Xl 







0 





^2(^7 — Vc X2 ) 



Thus 



[f(x),g i(x)] = 



~Tr{—kiX\ + kix 2 ) + fci(yf - ^x x ) 



k 2 ( y' y X2 ) 



Vc Vc 

vT - W"' 

After performing the same calculations for / and g 2 we get 



lf{x),g 2 {x)] = 

It’s easy to compute that 
\gi(x),g 2 (x)]= q 



- W x ^ 

-±(-k 2 X 1 + k 2 x 2 ) + k 2 (yy- - V^X 2 ) 



(6.51) 

(6.52) 

(6.53) 

(6.54) 

(6.55) 

(6.56) 

(6.57) 



Note that the above equation shows that the two input variables act on 
disjoint sets of state variables. 

With the above equations, we have for Z\i 



Ai = span{c/i, c/ 2 , [f,gi \ , [f,g 2 \ , [ 31 , 52 ]} (6.58) 

We can see from Equations (6.55) and (6.56) that the dimension of Ai is 
still zero if the corresponding inlet and outlet temperatures and the hot 
and cold side outlet temperatures are equal respectively. That is, we could 
not improve Aq and the algorithm stops here. 

In conclusion, we can say that the nonlinear heat exchanger cell model is 
controllable with the exception of the singular point (xi = T c ,, x 2 = Thi). 
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• Observability co- distribution 

Consider the nonlinear heat exchanger cell model (4.62)-(4.64) together 
with the output equation y = x\. The observability co-distribution after 
the first step of the algorithm is 

span { [ 1 0] , [-h fci]} 

which is of rank 2 at any point of the state-space, therefore the nonlinear 
heat exchanger cell with the above output selection is observable in the 
nonlinear sense. 

If we consider the engineering meaning of the non-controllability condition 
above, that is the corresponding inlet and outlet temperatures and the hot 
and cold side outlet temperatures are equal respectively, we can see that in 
this case there is no heat transfer between the hot and cold sides because they 
are at their equilibrium conditions. This means that the outlet temperatures 
of the heat exchanger will not change whatever happens to the flow rates, 
that is, the heat exchanger can’t be controlled via changing the flow rates, 
which is in perfect agreement with the computations above. 



6.4.3 Local Controllability of a Nonlinear 2-cell Heat Exchanger 



Consider the bilinear (nonlinear) state-space model of the heat exchanger 
cell developed in Subsection 4.4.4. We can construct a simple model of a 
countercurrent heat exchanger by connecting two such cells. The nonlinear 
functions / and g on the right-hand side of the input-affine state-space model 
are now as follows: 



f(x) = go{x ) = 



-ki c xi + ki c x 2 

k\hX\ kxjiX 2 
-k 2c x 3 + k 2c x 4 
k 2 hX 3 — k 2h x A 



9i(x) 



Vi cHxa- x 3 ) 

0 

V 2 - c \T ci - x 3 ) 

0 



92{x) 



0 

^1 h (Thi — X 2 ) 

0 

. V 2h( X 2 - X 4 ) _ 



(6.59) 



(6.60) 



Now we are in a position to compute the controllability distribution of the 
2-cell heat exchanger system as follows: 



A 0 = span{g!,52} 


(6.61) 


Ai =span{g 1 ,g 2 ,[f,gi],[f,g 2 ]} 


(6.62) 



Similarly to the bilinear heat exchanger cell case, the necessary Lie-brackets 
are computed as follows: 
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k lc k\ c 0 0 



df(x) _ 


kih 


-km 


0 




0 












dx 


0 


0 


-k 2c > 


'•C 2 c 














0 


0 


k 2 h 


- 


k 2 h_ 














'~Vu 


'0 Vr 1 


o' 






'0 


0 


0 


0 


dgi (x) _ 


0 


0 


0 


0 




dg 2 {x) _ 


0 


-ViH 1 


0 


0 


dx 


0 


0 - 


■v£ 


0 


5 


dx 


0 


0 


0 


0 




0 


0 


0 


0 






0 


V2h 


0 


-V2h\ 



(6.63) 



(6.64) 



[91,92) (x) = - [32,51] (x) 



0 

0 

0 

0 



(6.65) 



If, si] (x) = ^/(x)-^fg i(x) 

— V r i c 1 (— fci c a;i + ki c X2) + V lc 1 {—k2 C X3 + k2 C x 4 ) 
0 

-V^. 1 (-k 2c X3 + k 2c x 4 ) 

0 

- £ 1 ) 

_ ki h V-[ c 1 (x3 - xi) 

-k 2 cV 2 C \T ci - x 3 ) 
k 2 hV 2c 1 (T ci — x 3 ) 

kicVf/ixs - x 2 ) + k 2c V 1 - 1 (x4 - X 3 ) 
-kmV^ixs-X!) 
k 2 C V 2 -\T ci - £ 4 ) 

~k 2 hV^. 1 (T ci - x 3 ) 

If, 92 ] ( x ) = - ^r92{x) 

0 

- v ih(kihXi - k lh x 2 ) 0 
V 2 h 1 (kihXi - k lh x 2 ) - V^ h 1 (k 2 hX3 ~ k 2 hXi) _ 

ki c V^-{T hi - x 2 ) 

_ -ki h V^(T hi - x 2 ) 

k2cV 2 h{x 2 - X 4 ) 

_ -k 2 hV 2h 1 (x 2 - £ 4 ) . 

-k lc V{- h \T hi - x 2 ) 
kihVih(T hi - x-i) 

-k 2c V 2h 1 (x 2 - £ 4 ) 

_ki hV^ixi - x 2 ) + k 2 hV 2h 1 {x 2 - £ 3 ). 



( 6 . 66 ) 



(6.67) 
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Controllability Analysis. We can see from Equations (6.61) and (6.60) 
that the subspace spanned by the functions g i and g 2 is four-dimensional for 
almost any x\, ..., x 4 . The computation of A\ shows that the dimension of 
the distribution has not increased (it cannot in fact) therefore the bilinear 
2-cell heat exchanger model is controllable everywhere with the exception of 
the singular points. 

Singular Points. The dimension only decreases when 



T ci = xi , x 3 = xi , T hi — x 2 or x 2 = x 4 

i. e. the corresponding input and output temperatures are equal in any of the 
cells on the hot or cold side. Similarly to the single heat exchanger cell case, 
this can only happen if the cold and hot inlet temperatures are equal for a 
long time and thus there is no heat exchange in the operating unit, which is 
rarely the case in practice. 



6.5 Controllability of a Simple Continuous Fermentation 
Process 

In this section it is shown in the example of a simple continuous fermenter 
described in Subsection 4.5.3 that nonlinear controllability analysis based on 
the generation of controllability distributions is extremely helpful in identify- 
ing the singular points of the state-space around which control of the system 
is problematic or even impossible [76]. 

The nonlinear state-space model of the fermenter is given in Equations 
(4.78)-(4.79). The variables and parameters of the fermentation process 
model are collected in Table 4.1. 



6.5.1 Local Controllability Analysis Using the Linearized Model 



The linearized state-space model of the continuous fermenter is also devel- 
oped in Subsection 4.5.3 and it is given in Equations (4.84)-(4.87). After 
calculating the Kalman controllability matrix of the linearized model 



0=[B AB } 



-1.2194 0 

2.4388 -0.0031 



( 6 . 68 ) 



we find that the system is controllable (in the linear sense) in the neighbor- 
hood of the required operating point. 



6.5.2 Nonlinear Controllability Analysis Using Controllability 
Distributions 

For this, we need to identify the vector fields / and g in Equations (4.79) in 
Subsection 4.5.3. If we write them in the following general form 
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x = f(x) + g{x)u 
then it’s clear that 



Xi 




'X' 


_ x 2 _ 




s 



and 

f(x) = f(X,S) = 
g{x) = g(X,S) = 



u = F 



H{S+S 0 ){X + X 0 )- (X+ y o)Fo 



»(S+S o)(-Y+A'o) 
Y 



(X+X 0 ) 

(Sf~(S+Sq)) 

V 



(Sf — (S+Sq))F 0 
V 



(6.69) 

(6.70) 

(6.71) 

(6.72) 



We follow the algorithm described in Subsection 6.2.1 for calculating the local 
controllability distribution of the model. The initial distribution is 



A 0 = span{g} 



(6.73) 



In the following step we add the Lie-bracket of / and g to the initial distri- 
bution 



Ai = A 0 + span{ [/ , g}} = span{.g, [/, g}} (6.74) 

where 

[/ , a) ( x ) = ||/(a;) - y^g{x) (6.75) 

The second step then gives the following: 



A 2 = A! + [/, Ai] + [g, Ai] = span {g, [/, g ] , [/, [/, g \] , [g, [/, 5 ]]} (6.76) 

Singular Points. At the point 



[X S’] T = [—Xq Sf-S 0 ] T with X = 0 



9 

L l J 



,S = S F 



all the elements of A 2 (and, of course, all the elements of Z\o and Z\i) are 
equally zero. It means that the controllability distribution has rank 0 at 
this point. Moreover, this singular point is a steady-state point in the state- 
space. From this it follows that if the system reaches this (undesired) point, 
it’s impossible to drive the process out of it by manipulating the input feed 
flow rate. 

A 2 has rank 1 if 



X = -X„ (X = 0 y ) and S ^ S F - S 0 (be. S ^ S F ) 



From a practical point of view it means that if the biomass concentration 
decreases to 0 [|] then it can’t be increased by changing the input flow rate. 

Stability analysis of these singular points show that both of them are 
stable. 
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Non-singular Points. At any other point in the state-space including the 
desired operating point [X S\ =[0 0] , the controllability distribution has 
rank 2, which means that the system is controllable in a neighborhood of these 
points and we can apply state feedback controllers to stabilize the process. 



6.6 Controllability (Reachability) of Fed-batch 
Fermentation Processes 

The controllability (reachability) of a simple nonlinear fed-batch fermentation 
process model is investigated in this section. It is shown that the known 
difficulties of controlling such processes are primarily caused by the fact that 
the rank of the controllability distribution is always less than the number of 
state variables. 

Furthermore, a coordinates transformation is calculated analytically that 
shows the nonlinear combination of the state variables which is independent of 
the input. The results of the reachability analysis and that of the coordinates 
transformation are independent of the source function in the system model. 

The results are extended to the four state variable non-isotherm case, and 
to nonlinear fed-batclr chemical reactors with general reaction kinetics. 



6.6.1 Problem Statement 

Bio-processes in general and fermentation processes in particular are diffi- 
cult to model and to control even in the simplest cases. Various difficulties 
are reported in the literature, which include instability and controllability 
problems for both continuous and fed-batclr fermenters ([44], [43]). 

The dynamic state-space model of a fermenter is derived from first en- 
gineering principles which fixes certain structural elements in the model. As 
we have already seen in Subsection 4.5.2, the state equations are derived 
from dynamic conservation balances of the overall mass, component masses 
and energy if applicable. The speciality of a fermentation model appears in 
the so-called source function of these balances, which is highly nonlinear and 
non-monotonous in nature. 

The aim of this section is to use rigorous nonlinear analysis of a sim- 
ple fed-batch fermenter model for analyzing its reachability (controllability) 
properties and to relate them to the physico-chemical phenomena taking 
place in the reactor [75]. 



6.6.2 Nonlinear State-space Model 

The simplest dynamic model of a fed-batclr fermenter has been developed in 
Subsection 4.5.2, which can be written in the following input-affine form [44]: 
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x = f(x) + g(x)u 



(6.77) 



where 





X\ 




X 


X = 


X 2 


= 


s 




_ x 3_ 




V 



(6.78) 



f(x) 



and 



g{x 2 )xi 
-yfl(x 2 ) 2:1 
0 



K 1 +X2 + K 2 X% 

f^max 3 - 23-1 

(Kt_+X2 + K2X%)Y 

0 



n(x 2 ) 



fJ"max%2 

K\ + x 2 + K2X2 



g(x) 



a x 3 
Sf~X2 



1 



(6.79) 



(6.80) 



Note that the above model is exactly the same as Equations (4.71)-(4.74) 
and they are repeated here for convenience. 

The variables of the model with their units and the constant parameters 
with their typical values are also listed in Subsection 4.5.2. 



6.6.3 Reachability Analysis 

We construct the reachability distribution according to the algorithm de- 
scribed in Subsection 6.2.1 as follows: 



A 0 = span{g} 

Ai = A 0 + [f, A 0 ] = span {</, [/, g ]} 

A 2 = A x + [/, Ax] + [g, A x ] = span {g, [f,g\ , [/, [f,g]] , [g, [ f,g ]]} 

The calculation of the Lie-products in Ai and A 2 is as follows: 

[/.»] (*) = ||/(*) - %.9{x) (6.81) 

Since 



dg ,, , 

wJ ix) = 



— — 0 ^ 
X3 X3 

0 -A. *=»-// 



X3 

0 





fi(x) 




'4/iW 






= 






0 




0 



(6.82) 



and 



df , , 
di ,j(x) = 



mM * 0 

0 0 0 



ffi(x) 

Mx) 

0 
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H(x 2 )gi(x) + §^ 92 {x) 
-y{li{x 2 )gi{x) + §^g 2 {x)) 
0 

the Lie-product [/, g\ has the form 



1 




1 

1 


if,g \ 2 


= 


-F if, 9)i 


co 




O 



(6.83) 



(6.84) 



where [/, g] t denotes the i-tli coordinate function of the vector field [/, g\. 

It follows from Equations (6.81)-(6.84) that the distributions [/,[/, g\] 
and [g, [ f,g ]] will also have the same form as (6.84), i.e. 



if, If, 9]] 



L f > \f,9\\ 1 
~7 if, if, 9]\ 1 
0 



and 



[9, if, 9 }} 



[9, if, 9 }} 1 
“F \9,if,9]\ 1 
0 



(6.85) 



( 6 . 86 ) 



On the basis of the above we can denote the coordinate functions of the 
vector fields spanning A 2 at a given point x of the state-space as follows: 



A 2 (x) = span{ 



<5n(a:) S i 2 (x) Si 3 {x ) <5i 4 (ar) 
S 2 i{x) 6 22 (x) S 23 (x ) S 24 (x) 
<$ 3 i (x) S 32 (x ) <5 33 (x) <5 34 (x) 



} 



where 



631 = 1, £32(2;) = <533(2:) = <534(2:) = 0 



and 



<522(2;) 

<523(2:) 

< 524 ( 2 :) 



-y8i 2 {x) 

-^ 13 ( 2 :) 

-^ 14 ( 2 :) 



(6.87) 



( 6 . 88 ) 

(6.89) 

(6.90) 

(6.91) 



^ 2 ( 2 :) 



span{ 



<5n(ar) 
<521 (a:) 

1 



<5i2(a;) 

-^< 512 ( 2 :) 

0 



<5i3(a:) 

-^^ 13 ( 2 :) 

0 



<5i 4 (a;) 

-ySi 4 (x) } 

0 



(6.92) 



which means that we couldn’t increase the dimension of the reachability 
distribution in the second step and the rank of A 2 is at most 2 at any point 
in the state-space. 
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Singular Points. There are, however, points in the state-space where the 
rank of the reachability distribution A -2 is less than 2. Those points are char- 
acterized by 

a;i=0 

In this case, A 2 is of dimension 1. This case means that there is no biomass 
in the system and since the inlet flow contains only substrate, the biomass 
concentration cannot be influenced by manipulating the input. 

During the following analysis we will consider the open region of the state- 
space where Z\i is nonsingular and the value of state vector has real physical 
meaning (the concentrations and the liquid volume are positive), i.e. 

U = {xi,X2,X3\xi > 0,X2 > 0 , £3 > 0} (6.93) 



6.6.4 Calculation of the Coordinate Transformation 



Since the generation of the reachability distribution stopped in the second 
step with 



Ai = span{g, [f,g]} 



A\ is the smallest distribution invariant under /, g and containing the vector 
field g. This distribution is denoted by (/, p|span{g}). Since (/, <?|span{<jf}) is 
nonsingular on U and involutive we may use it to find a coordinates trans- 
formation z = <?■( x ). The system in the new coordinates will be represented 
by equations of the following form (see Theorem 6.2.1): 

Ci = /1 (Ci, <2) + fl«i,C2)w (6.94) 

C2 = H C2) (6-95) 

where Ci = [zi Z 2 ] T and C 2 = 23 in our case. 

To calculate <P, we have to integrate the distribution A\ first, that is, to 
find a single (dim(:r) - dim(Z\i) = 3-2 = 1) real-valued function A such that 
spanjdA} = [(/, c/|span{g})] , where the sign J_ denotes the annihilator of a 
distribution. Since 



[/» 9\ (z) 



K 1+X2+ k 2 x 2 



x 2 x i( 1 + 2 K2*2) \ (S x ) 

(K 1 + x 2 + K 2 x I ) 1 ) y 1 



t^max x 1 



(K 1 +x 2 + K 2 x$)Y 



+ »rnax* 2 xi(l+2K 2 x 2 ) \ ( g ) 

(K 1 + x 2 + K 2 x%) J Y ) y 1 



X3 

0 



(6.96) 



this amounts to solve the partial differential equations (PDEs) 



d\ d\ dX ' 
dxi dx2 dx3 . 



xi 

X 3 



Sf-x 2 

1 



f J "max x 1 

K 1 +x 2 + K 2 . 



,2 

2 






V"max x 2 X 1 (1 + 2 K 2 x 2 ) \ 
(Kl+ X 2+K 2 x 2 ) 2 / 

X3 

_|_ ^max x 2 X 1 (1+2K 2 x 2 ) 

(K- 1 +a ? 2 +K 2 »l) 2 y~ 

X 3 



( Sf~X 2 ) 

) (Sf-x 2 ) 



0 
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= [0 0] (6.97) 

Solution by the Method of Characteristics. The method of characteris- 
tics (see, e.g. [12], [8] or [53]) is used for solving the above resultant first-order 
linear homogeneous partial differential equation in the following general form: 



^ ~2<t>i{x)di\{x ) = 0, 
i = 1 

or briefly 




(6.98) 



<fi(x)X'(x) = 0, 



(6.99) 



where T C R" is a domain, x G T, <f>i, i = 1 . . . n are known functions and A 
is the unknown. The characteristic equation system of (6.99) is the following 
set of ordinary differential equations: 

z = m (6.100) 



We call the £ : R — > R" solutions of (6.100) characteristic curves. A A G C 1 (T) 
function is called the first integral of (6.100) if t —> A (£(t)) is constant along 
any characteristic curve. In order to solve (6.99) we have to find (n— 1) linearly 
independent solutions (Ai, A 2 , . . . , A„_i) of it. Then the general solution of 

(6.99) will be in the form A = ^(Ai, A 2 , . . . , A„_i), where <P G C 1 (R" _1 ) 
is an arbitrary function. We know that a first integral of (6.100) satisfies 

(6.99) , therefore we have to find (n — 1) linearly independent first integrals 
to obtain the general solution. This can be done without solving (6.100), as 
is illustrated below in our case. 

To solve the first PDE, namely 



d\ / aqA d\ /S/ — £2 A dX 

dxi \ x 3 ) dx 2 V x 3 ) dx 2 



(6.101) 



we start from the following set of ordinary differential equations: 
_xi 
x 3 

S f - x 2 



Xl 

x\ = 

X 3 



X 2 = 



X 3 



*3 = 1 

It’s easy to observe that 



* 1*3 = ~x\ 



and 



*1*3 + *3*1 = (*1*3)' = 0 




6.6 Controllability (Reachability) of Fed-batch Fermentation Processes 127 



since x 3 = 1. Therefore X 1 X 3 = const. Moreover, 



X2X3 = Sf — X 2 



and 



±2X3 + X2X3 - SfX 3 = (. X2X3 )' - S f x 3 = 0 



from which it follows that 



X 2 X 3 — SfX 3 = const. 



We can see from the above that the solution of (6.101) will be in the form 



\(xi,X2,X 3 ) = <P(x 1 X3,X2X3 - SfX 3 ) 
with an arbitrary C 1 function <P. 

To solve the second PDE we first remember that in the reachability dis- 
tribution 

S 22 = ~ ^7^12 and 532 = 0 
and then it’s enough to write the PDE as 

^ 612{X) + £ (^ 12(a;) ) = ° (6 - 102) 
The characteristic equations are written as 
±1 = S 12 {x) 

X2 = ~ySl2(x) 

X3 = 0 

It’s easy to see that 

-T7X! - ±2 = 0 



and 



x 3 = 0 

Therefore the solution of (6.102) is in the form 

\(X1,X 2 ,X 3 ) = ^{-yX! - X 2 ,X 3 ) 



(6.103) 



with an arbitrary C 1 function <P*. To give a common solution for both (6.101) 
and (6.102) we propose the function 
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A(aJi,£ 2 ,£ 3 ) = X 3 (~yX 1 -X 2 + Sf) = - — XiX 3 - (x 2 x 3 - SfX 3 ) (6.104) 

from which we can see that it indeed satisfies both PDEs. With the help 
of A we can define the local (and luckily global) coordinates transformation 

V : r -> 



Z\ 




Xi 


Z 2 


= &(x 1 ,X 2 , x 3 ) = 


X 2 


_ z 3 _ 




_~yX iX 3 - X 2 X 3 + SfX 3 _ 



(6.105) 



Since 



x 3 



Z 3 

~Y Z 1 ^ z 2 + Sf 



and 

z 3 = (~yXix 3 - x 2 x 3 + SfXaY 

= ~y(xiX 3 + X\X 3 ) - (± 2 X 3 + X 2 X 3 ) + SfX 3 

= - y(Ix(x 2 )xi x 3 -x 1 + Xi) - y /J-(x 2 )xiX 3 + Sf - x 2 + x 2 ) + Sf = 0 

the transformed form of the model (6.77)-(6.79) can be written as 

z = f(z) +g(z)u (6.106) 



where 



m 



Mmacc %2 %1 
K 1 +Z 2 +K 2 Z 2 




" -^(-M -Z2 + Sf) ' 


f-^max %2 %1 


II 


/ z 3 2 ( Y Z 1 *2 + Sf) 


( K 1 +Z 2 +K 2 z'i)Y 


0 


l 


0 



(6.107) 



and z 3 ^ 0. 



6.6.5 Generalizations 

The aim of this section is to show the reasons present in the original state- 
space model which led to the reachability and state transformation above. 
This analysis enables us to find other models of similar form with the same 
properties. 

Physical Analysis of the Model and the Solutions. The first important 
thing to observe is that the results of the reachability analysis and that of the 
coordinates transformation do not depend on the actual form of the function 
/i in Equation (6.80). The results utilized the following specialities of the 
original state-space model in Equations (6.77)-(6.79). 
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1. The constant coefficients in the third state equation, i.e. 

h = 0, 33 = 1 

where /, and gi are the i-th entry of the vector functions / and g in 
the state-space model. This property always holds for the overall mass 
balance of fed-batclr reactors. 

2. The relation between the first and the second state equation, namely 

h = -yh = C f h 

where Cf is a constant. Such a relationship exists if the two related 
state variables, x\ and x 2 , are concentrations of components related by 
a chemical reaction in the form yS — > X [32]. 

Further, we may notice that the quantity A in Equation (6.104) - which is 
conserved independently of the input - consists of two parts corresponding 
to the substrate mass and cell mass of the system as follows: 

A(zi, x 2 , x 3 ) = V(S f - S) + yV(X f - X) (6.108) 

with Xf = 0 because the feed does not contain any cells. The above two 
terms originate from the (weighted) convective terms in the component mass 
conservation balances respectively, that is, such terms which are only caused 
by the feed as inflow. 

Generalized State-space Models. We can generalize the original model 
in Equations (6.77)- (6.79) in two steps if we want to preserve the special 
dynamic properties of the model. 

1. General reaction rate function 

As the results do not depend on the function g in Equation (6.80), we 
can replace the fermentation reaction by a general chemical reaction of 
the form 

v s = x 

where the reaction rate (source) function is g*{x 2 )x\ with g* as an un- 
specified possibly nonlinear function. 

2. Non-isotherm case 

If we further release the assumption that the fermenter is operating under 
isothermal conditions, then we should include the energy conservation 
balance to the original model. Then a four state model is obtained [32] 
in the following input-affine form: 

x = f*(x) + g*(x)u (6.109) 



where 
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Xl 




' A ' 


X2 




S 


x 3 




T 


X4 




V 



u = F 



( 6 . 110 ) 



with T being the temperature in the fermenter. Then the nonlinear func- 
tions /* and g* are 



H*(x 2 ,x 3 )x 1 
CiH*(X2,X 3 )xi 
C 2 ll*(x 2,X 3 )xi 

0 



9*{x) 



Xl 

X 4 

Sf~X 2 



X 4 

Tf-x 3 



X4 

1 



( 6 . 111 ) 



with c\ = ~y a nc l with the following additional constant parameters: 

C 2 reaction enthalpy coefficient [m 3 K/J] 

Tf = 293 influent temperature [K] 

Observe that now the reaction rate function g* depends also on the tem- 
perature x 3 = T, giving rise to the source function g*{x 3 ,x 3 )x\. 

Furthermore, the required structural properties 1. and 2. are present in the 
generalized model. The property 1. now holds for the entries /| and g\, which 
is the overall mass balance. There are two independent pairs, (/ 1 ,/|) (the 
two component mass balances) and (/*, /|) (a mass and an energy balance) 
which possess property 2. with different constants. 

Analysis of the Generalized Models. In the above four state variable 
case the final reachability distribution after four steps would be the following: 



A = span{g* , [/*,<?*] , [/*, [f*,g *]} , [«?*, [/*,<?*]] , 

[/*,[/*,[/*, 5 *]]], 

{r,[9*,[r,9*}]\,i9*,[g*,[r,9*m 

If we calculate the Lie-products [/*,<?*], [/*, [/*,<?*]] and [g*, [f*,g*]], we find 
that 



[/*,»*] = 



' [f\9\ ‘ 




' [/ *,[f*,9*]} 1 ~ 


ci [t,g*]i 


, ir,ir,9*}} = 


Cl [/*,[/*, flllr 


c 2 If*, 9*1 


C2 [/*,[/*, 0% 


0 




0 



and also 



[g*,[r,9*}} = 



[<?*,[/*,<?*]]! 
Cl [g*,[f*,9*]\i 
C2 [»*,[/*,«?*]] i 
0 



( 6 . 112 ) 



(6.113) 



Therefore the calculation of the reachability distribution stops here and it 
turns out that the dimension of the distribution is 2 in this case, too. 
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To find the decomposed system similar to (6.107), we have to find two inde- 
pendent real-valued functions Ai and A 2 such that 



c>Ai d\i <9Ai OAi 
dx\ dx 2 dx3 dx4 
9X2 9 X 2 9 X 2 9X2 
9 x 1 9x2 9x3 9 x 4 



ffi ( x ) [f* 1 9 *] 1 ( x ) 
92 ( x ) Cl [f*,9*]i ( x ) 
9ti x ) c 2 [/*,5*]i ( x ) 

1 0 



0 0 
0 0 



(6.114) 



It’s easy to check that the two independent functions 

Ai (x) = x 4 (ciXi — x 2 + Sf) (6.115) 

A 2 (a;) = x 4 (c 2 x 1 - x 3 + Tf) (6.116) 

satisfy the PDEs in Equation (6.114). Therefore the new coordinate vector z 
is given by the function \P* : R 4 — > K 4 



(6.117) 



’ 21 " 




X\ 


22 

23 


= v*{x) = 


x 2 

xa{c\Xi — x 2 + Sf) 


_ 2 4 _ 




_x 4 (c 2 x 1 - x 3 + Tf) _ 



and the system (6.109)-(6.111) in the new coordinates is written as 
z = f*{z) +g*{z)u 
where 



f*(z) = 



ji*(zi,z 2 ,z 3 ,z 4 )zi 




zl(cizi — z 2 + Sf) 
Z3 


Clfi*(zi,z 2 , 23 , 24)21 

0 


» 9*{z) = 


(Sf—Z 2 )(ciZ 1 —Z2+Sf) 


23 

0 


0 




0 



(6.118) 



(6.119) 



and 



H*(z 1 ,z 2 ,z 3 ,z 4 ,) = n* ^z 2 ,c 2 z 1 +T f — 



za{ciZi — z 2 + Sf) 



Z3 



( 6 . 120 ) 



with the condition z 3 ^ 0. 



6.6.6 Engineering Interpretation 

The invariance of A in Equation (6.104) expresses the fact that the state vari- 
ables of the fed-batch fermenter model can only move on a smooth hypersur- 
face in the state-space. The shape of this hypersurface obviously depends on 
the choice of the initial values of the state variables. It means that the ini- 
tial concentrations and liquid volume (that are set by the control engineer) 
uniquely determine the set of points in the state-space that are reachable 
during the process. 
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Figures 6.1 and 6.2 illustrate the effect of the initial liquid volume on 
the reachability hypersurface when the concentrations are fixed. It is shown 
that if the initial volume is too small then the possibilities of controlling the 
biomass concentration x\ are dramatically worsening. Similarly, the effect of 
the initial concentrations can also be easily examined, since A in Equation 
(6.104) is a quite simple function of the state variables. 

With the help of A controller design becomes easier. If the desired final 
point of the fermentation is given (in the state-space) then the initial condi- 
tions can be set in such a way that the desired point is reachable. 




Figure 6.1. The reachability hypersurface of the fed-batch fermenter for initial 
conditions £i(0) = 2|, £ 2 ( 0 ) = 0.5|,£3(0) = 0.5f 



6.6.7 Comments on Observability 

Due to space limitations we cannot go into detail concerning the observability 
of fed-batch fermentation processes, we can only briefly describe the most 
interesting aspect of the relation between reachability and observability. The 
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Figure 6.2. The reachability hypersurface of the fed-batch fermenter for initial 
conditions xi(0) = 2f, *2(0) = 0.5f ,*3(0) = O.lf 



rough problem statement of observability is the following: is it possible to 
determine the values of the state variables of the system if we measure the 
inputs and the outputs? 

Obviously, the observability property of linear and nonlinear systems 
largely depends on the selection of the output function y = h{x). Let us 
suppose that the output of the system (6.77)-(6.79) is chosen to be A in 
Equation (6.104). Without complicated calculations it is clear, that the sys- 
tem won’t be observable because A is constant in time independently of the 
input u and therefore it does not provide any information about the internal 
“movement” of the system. It’s value only identifies the reachable hypersur- 
face (manifold). 
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6.6.8 The Minimal Realization of Fed-batch Fermentation 
Processes 



Using the calculated A function, it’s not difficult to give a minimal state- 
space realization of fed-batch fermentation processes in the temperature- 
independent case. 

Since the reachability hypersurface defined by A and shown in Figures 
6.1 and 6.2 is two-dimensional, the minimal realization will contain two state 
variables (i.e. the input-to-state behavior of the system can be described by 
two differential equations). Since A is constant in time, it’s clear that 

A(a;(f)) = - ( x 2 (t)x 3 (t ) - S f x 3 (t )) (6.121) 

= -^a;i(0)x 3 (0) - (x 2 (0)x 3 (0) - S f x 3 ( 0)) = A(z(0)) 

Therefore we can express, e.g. the volume x 3 from the above equation in the 
following way: 



x 3 



Hx{0)) 

-yXi + Sf - X 2 ’ 



1 

Y 



X\ + Sf — X2 ^ 0 



( 6 . 122 ) 



and the minimal state-space model reads 



X — fmin(x ) + gmin(x)u 



where 



Qmin 



0) 



X = 


Xi 

X 2 


? fmin (^) — 


f-^max^ 2^1 
K 1 +X 2 +K 2 x% 
l-^max ^ 2*^1 






( K 1 +x 2 +K 2 x%)Y 



yl(+ll(X2 ~Sf) 
A(x(0)) 

(- 3 -Xl+Sf-X 2 )(Sf—X 2 ) 



(6.123) 



It’s well-known from system theory that state-space realizations are not 
unique and it’s easy to see that instead of x 3 any one of the other two state 
variables could be expressed from Equation (6.121). Therefore one can select 
those two state variables that are important from a certain point of view (e.g. 
a control problem) and express the third one from Equation (6.121). 

It’s also important to remark that the model (6.123) has a special struc- 
ture, since it contains the initial values of the original model (6.77)-(6.79) in 
the input vector field g m i n (but luckily not in the vector field fmin)- 



6.7 Further Reading 

The controllability and observability of linear systems is covered in several 
good textbooks, e.g. in [39], [20] or [13], to mention just a few. Although [7] 
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is mainly devoted to linear systems, it discusses important connections to 
nonlinear systems. 

Additional results about the controllability of nonlinear systems can be 
found in [70] and [73]. The observability and the problem of identifying the 
initial state in a single-input nonlinear system is studied in [72]. The reach- 
ability and observability of bilinear systems are discussed in [14]. 



6.8 Summary 

Based on the controllability and observability notions and analysis tools de- 
veloped for LTI systems, the basic concepts and algorithms for analyzing 
state controllability and observability of input-affine nonlinear systems are 
described in this section. 

The nonlinear notions and methods are illustrated using case studies of 
process systems of practical importance: heat exchangers and fermenters of 
various type. Their controllability and observability analysis is based upon 
the special nonlinear structure of process systems and on their input-affine 
nonlinear state-space model developed in Chapter 4. 



6.9 Questions and Application Exercises 

Exercise 6.9.1. Compare the notions and tools related to linear and non- 
linear controllability analysis. Comment on the obtained analysis results and 
on the computational resources needed. 

Exercise 6.9.2. Compare the notions and tools related to linear and non- 
linear observability analysis. Comment on the obtained analysis results and 
on the computational resources needed. 

Exercise 6.9.3. Perform linear controllability and observability analysis of 
the nonlinear heat exchanger cell described in Section 4.4.4 using its linearized 
state-space model developed in Exercise 4.8.10. 

Exercise 6.9.4. Consider the following two-dimensional nonlinear system 
model in its input-affine state-space form: 



dx i 
dt 
dx 2 
dt 



1/2 3/2 3 1/2 

= Xi X 2 — X\X 2 + X{ Iti 

= Zx\X l 2 ' 1 — 2x\x2 



3 2/3 1/2 2 

y = x\x 2 — Xi x 2 

Compute the controllability distribution A c for this system and determine 
if it is controllable or not. 
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Exercise 6.9.5. Consider the following two-dimensional nonlinear system 
model in its input-affine state-space form: 



dx i 
dt 
dx 2 



Xi 



X 2 T 2x\ T 3 

Xl 

dt x\ + 2xi + 3 



= 4- 



— X\U\ 



Xl 

X2U1 U 2 

X2 



y = 



Xl 

X 2 



Compute the controllability distribution A c for this system and determine 
its rank. 

Exercise 6.9.6. The following two-dimensional nonlinear system model is 
given: 



dx 1 

— — = — a;ie 2 — X\U\ 

dt 

dx 2 . _ TO 

— — = 2 x\e 2 — x 2 u 1 + X2U2 
dt 

y = e Xl 

Determine the controllability of the system using its controllability dis- 
tribution A c . 
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Stability is a basic dynamic system property. It characterizes the behavior 
of a system if that is subject to disturbances. In general everyday terms, 
a system is regarded to be “stable” if it is not disturbed too much by the 
external disturbances, but rather it dampens their effect. 

There are various but related notions in systems and control theory to 
characterize the stability of a system. Internal or asymptotic stability focuses 
on the effect of the disturbance on the state of the system in a long time 
horizon, while external or bounded-input- bounded-output (BIBO) stability 
deals only with the effect seen in the system outputs. 

The Lyapunov method for checking asymptotic stability is the technique 
which is applicable for nonlinear systems. Therefore we summarize the no- 
tions of stability and the Lyapunov method here in this chapter together with 
checking stability for both linear and nonlinear systems. 

The material is arranged in the following sections: 

• Stability notions 

Here we describe both the bounded- input bounded-output (BIBO) and 
the asymptotic stability case. First, the general notions are given, then we 
illustrate them in the LTI case by stating necessary and sufficient condi- 
tions. 

• Local stability of nonlinear systems 

Thereafter, the local stability of the nonlinear case is discussed together 
with the description of local linearization techniques. 

• Lyapunov’s theorem and Lyapunov functions 

We start with the notion of the Lyapunov function as a generalized energy 
function. Thereafter Lyapunov’s theorem on asymptotic stability is stated. 
As an illustration the Lyapunov conditions for the LTI case are also given. 

• Stability of process systems 

Besides the analytical techniques for analyzing stability, the notion of struc- 
tural stability and an algebraic method for its analysis is introduced. 

• Examples and a case study 

The stability analysis techniques are illustrated using simple well-known 
process examples (heat exchanger cells, mass convection network and a 
binary distillation tray) and on a simple continuous fermenter. 
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7.1 Stability Notions 

There are two different but related notions of stability: 

1. Bounded-input-bounded output (BIBO) stability, which describes the be- 
havior of the system if it is subject to bounded but permanent distur- 
bances. 

2. Asymptotic stability when the disturbance acts as an impulse (over an 
infinitesimally short time interval) and then the system behavior is ana- 
lyzed when time goes to infinity. 



7.1.1 External or BIBO (Bounded-input— bounded-output) 
Stability 

In order to define BIBO stability, we need to recall the notions of vector and 
signal norms which are summarized in Appendix A in Section A.l. 

Definition 7.1.1 (BIBO stability) 

A system is external or BIBO-stable if for any bounded input it responds with 
a bounded output 

{||t((t)|| < Mi <oo | 0 < t < oo} => {||y(t)|| < Mi < oo | 0 < t < oo} 

(7.1) 



where ||.|| is a vector norm. 

Observe that the definition above says nothing about the states but uses 
the concept of input-output representation of the system S. If we denote 
the signal norm of the input by ||w|| and that of the output by ||u|| then 
the defining equation (7.1) can be interpreted as a condition for the system 
operator S: 

||S|| < oo (7.2) 

where 1 1 S 1 1 is the induced operator norm by the signal norms for the input 
and output signals. 



7.1.2 BIBO Stability Conditions for LTI Systems 

Recall from Chapter 5 that the impulse-response function h or the transfer 
function H is used to describe the abstract system operator S of LTI systems. 
Therefore it is natural to look for conditions of their BIBO stability in terms 
of the properties of their impulse-response or transfer function. 

The theorem below gives a simple example of such results for the case of 
single-input-single-output LTI systems. 
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Theorem 7.1.1 (BIBO stability of SISO LTI system). A single-input- 
single-output (SISO) LTI system is (externally or) BIBO-stable if and only 

if 

\h(t)\dt < M < oo (7.3) 

where M is a constant and h(t) is the impulse-response function of the system. 

7.1.3 Z/ 2 -gain of Linear and Nonlinear Systems 

The concept of Z/ 2 -gain (see Subsection 2.2.2) of an LTI system plays a central 
role in the investigation of stability and performance of control systems. In 
this section we extend and refine this concept to a class of nonlinear systems, 
too. 

In order to define the L 2 -gain of a linear system we go back to the original 
definition of BIBO stability given by Equation (7.1) and develop a special 
case of it. 

Definition 7.1.2 (L 2 -gain for linear systems) 

A linear system with input u and output y has L 2 ~gain less than or equal to 

1, if 

pOO pOO 

/ \\y\\ 2 dt<^ \\ufdt (7.4) 

J o Jo 

Observe that the integrals in the above inequality are the 2-norms of the 
signals u and y, that is 

pOO 

/ ||i/|| 2 dt = Ill/ll! 

Jo 

We assume that the squared 2-norm / 0 °° ||u|| 2 is finite in Equation (7.4). 
In this case the BIBO stability of the system implies that there exists a finite 
7 2 such that it holds. 

It is known that finite L 2 ~gain implies BIBO stability of a linear 
system. 




In the theory of nonlinear systems, however, the notion of L 2 -gain has a 
slight difference when compared to the defining Equation (7.4). 

Consider a nonlinear system given by an input-affine nonlinear state-space 
model: 

x = f(x) + g(x)u u G R m , /( 0) = 0 
y = h(x) y G h( 0) = 0 

where x = (xi , . . . , x n ) are locale coordinates for a e.g. C k (k times continu- 
ously differentiable functions, k > 1) state-space manifold A4. 

The ^ 2 -gain concept can be carried over to the system described in Equa- 
tion (7.5) in the following form: 
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Definition 7.1.3 (X 2 -gain for nonlinear systems) 

The nonlinear system (7.5) has L 2 -gain less than or equal to j, if for all 
x G A4, 3 K(x), 0 < K[x) < oo, A^(0) = 0, such that for every T > 0: 

[ T || y\\ 2 dt < 7 2 [ T \\u\\ 2 dt + K(x(T)) (7.6) 

Jo Jo 

Observe that the function K{.) gives the “remaining part” of the integrals in 
Equation (7.4) from T up to oo and therefore it should be taken at the point 
x(T). Furthermore, it is clear that the function A'(.) is not unique. 

The function K{x) in the above definition gives rise to the notion of the 
available storage, which leads to the storage function of the system (see later 
in Chapter 8). 



7.1.4 The Small-gain Theorem 

For closed-loop systems the celebrated small-gain theorem can be used to 
investigate BIBO stability. The small-gain theorem is based on the operator 
description of a composite system consisting of two interconnected subsys- 
tems. The notations and results presented in this subsection are based on 
[80], where the complete proof of the theorem can be found. 

For the general statement of the small-gain theorem it is necessary to 
define the notion of Testability and finite A g -gain of relations instead of 
maps. 

Definition 7.1.4 (Xg-stability and finite L q - gain of relations) 

• Ac L qe (U ) x L qe (Y) is L q -stable if for all 
( u,y ) € A, u G L q (U) y G L q (Y), 

• Ac L qe (U ) x L qe (Y) has finite L q -gain if^ q ,b q € R. 
such that for all T > 0 

(u,y) G A, u € L qe {U) => \\y T \\ q < 7 q \\u T \\ q +b q . 

General Feedback Configuration. The general feedback configuration 
consists of two interconnected subsystems with their system operators G\ 
and G 2 , and is shown in Figure 7.1. 

The signals appearing in the closed-loop system S^ Gi q 2 are as follows: 

u 1 (t),y 2 (t),e 1 (t) G Ex, Vt > 0 (7.7) 

u 2 (t),y 1 (t),e 2 (t) G A 2 , Vt > 0 (7.8) 

where dim(Ai)=m and dim(A 2 )=n. 

The subsystems forming E J Gl g 2 are 

G\ : L qe (Ai) e- > L qe (E 2 ), G 2 : L qe (E 2 ) 1 — > L qe (Ei) (7-9) 

Furthermore, we assume that e\ G L qe (Ei) and e 2 G L qe (E 2 ). 

It’s clear from Figure 7.1 that 
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ui = ei - 2/2, = e 2 + 2/1 

2/i = G(iti), y 2 = G 2 {u 2 ) 

Let us use the following notations 



u = 






(7.10) 



(7.11) 



Then the feedback connection of the two subsystems is described as 



y = G(u) and u = e — Fy 



(7.12) 



where 



G = 



G 1 0 

0 g 2 



(operator matrix), F 





(real matrix) (7.13) 



Then the overall input and output signals are expressed as 

y = G(e — Fy) (7.14) 

u = e — FG(u) (7.15) 

The closed- loop system defines two relations: 

Reu — {(e,u) G LqeiEj. x E 2 ) x L qe (Ei x E 2 ) \ u + FG(u) = e} (7.16) 
Rey = {( e,y ) G Lq^Ex x E 2 ) x L qe (E 2 x Ei) \ y = G(e - Fy)} (7.17) 

The most important properties of the closed-loop system are the following: 



• R eu is Lq-stable <t=> R ey is L g -stable, 

• R eu has finite L 9 -gain <t=> R ey has finiteL 9 -gain, 

• let Gi and G 2 be causal 1-0 mappings corresponding to causal systems 
(see Section 2.2.1). Then Eq Ga is also causal in the following sense: 

1. Ut depends only on er for all (e,u) G R eu and T > 0. 
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2. x)t depends only on er for all ( e,y ) € R ey and T > 0. 

Now we can state the small-gain theorem in its most general form as follows: 

Theorem 7.1.2 (Small-gain theorem). Consider the closed-loop system 
^Gi G 2 an d ^ 9 ^ {1, 2, . . . , oo}. Suppose that G\ and G 2 have L q -gains 
7 g (Gi) and r ) q (G 2 ) respectively . The closed-loop system has finite L q -gain if 

7 9 (Gi) • 7q(G 2 ) < 1 

7.1.5 Asymptotic or Internal Stability of Nonlinear Systems 

Asymptotic stability corresponds to a situation where the effect of an impulse- 
type disturbance moves out the state of the system from its non-perturbed 
(nominal) value over an infinitesimally short time interval and then the per- 
turbed state evolution is compared to the nominal one. As we are interested 
in the time evolution of the state variable(s), we need to have a state-space 
model of the system for analyzing asymptotic stability. Also, the focus is on 
the behavior of the state variables, these being internal signals of the system: 
it explains why asymptotic stability is also called internal stability. 

Because of the above situation, we consider identically zero inputs, i.e. 
u(t) = 0 in the state-space model of the system when analyzing asymptotic 
stability. 

Definition 7.1.5 (Truncated state equation) 

A state equation with identically zero inputs is called a truncated state equa- 
tion. 

In order to give a rigorous mathematical definition of asymptotic stability in 
the general nonlinear case, let us have a truncated nonlinear state equation 
(with u(t) = 0) as follows: 

^ = /(M) (7-18) 

and let it have two solutions: 

• x°(t) for x°(fo) as the ordinary solution, and 

• x(t) for x(to) which is a “perturbed solution”. 

Definition 7.1.6 (Stability of a solution) 

The solution x°(t ) of Equation (7.18) is stable if for any given e > 0 there 
exists a 5(e,to) such that all solutions with ||a;(to) — ar(fo)|| < S fulfill ||a;(f) — 
£°(<)|| < e for all t > to where ||.|| is a suitable vector norm. 

The above stability notion is used to state the definition of asymptotic sta- 
bility. 
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Definition 7.1.7 (Asymptotic stability, weak) 

The solution x°(t) of Equation (7.18) is asymptotically stable if it is stable 
and ||x(f) — x°(f)|| — > 0 when t — > oo provided that ||x(fo) ~ tc° (io ) 1 1 is small 
enough. 

The above definitions have a very special property as compared to the notion 
of BIBO stability. 

Asymptotic stability is a property of a solution for nonlinear sys- 
tems. 



Asymptotic Stability of Input-affine Nonlinear Systems. In the case 
of input-affine nonlinear systems, we assume that f(x, t) = f(x) and /( 0) = 0. 
Then Equation (7.18) has a stationary solution x°(t) = 0 for a; 0 (to) = 0. In 
this case, the notion of asymptotic stability is used in a more strict sense as 
follows: 

Definition 7.1.8 (Asymptotic stability, strong) 

Equation (7.18) is asymptotically stable if ||x(t)|| — > 0 when t — > oo provided 
that ||x(to)|| is small enough. 

7.1.6 Asymptotic Stability of LTI Systems 

In order to investigate the similarities and differences of asymptotic stabil- 
ity for nonlinear and linear systems, we start with the usual definition of 
asymptotic stability special to LTI systems. 

Definition 7.1.9 (Asymptotic stability of LTI systems) 

An LTI system with realization ( A,B,C ) is (internally) stable if the solution 
x(t) of the equation 

x(t) = Ax{t ), x(to) = xq ^ 0, t > to (7.19) 

fulfills 

lim x[t) = 0 

t— >00 

The condition above is similar to asymptotic stability of linear ordinary dif- 
ferential equations. Moreover, this notion is exactly the same as the strong 
asymptotic stability but there is no need for ||x(t 0 )|| to be “small enough”. 
The reason for this difference is explained later. 

In order to develop necessary and sufficient conditions for an LTI system 
to be asymptotically stable, the following definition will be useful: 

Definition 7.1.10 (Stability matrix) 

A square matrix A £ R”®" is said to be a stability matrix if all of its eigen- 
values Aj(A) have strictly negative real parts, i.e. 



Re{\i(A)} < 0 ,Vi 
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The following proposition shows the effect of state transformations on the 
stability matrix property. 

Proposition 7.1.1. The eigenvalues of a square A € K”®" matrix remain 
unchanged after a similarity transformation on A, i.e. with 

A = TAT- 1 

we have the same eigenvalues for both A and A. 

Now we are in a position to state the necessary and sufficient condition 
for an LTI system to be asymptotically stable. 

Theorem 7.1.3 (Asymptotic stability of LTI systems). An LTI system 
is asymptotically (internally) stable if and only if its state matrix A is a 
stability matrix. 

The above proposition and theorem together show that the stability prop- 
erty of a system remains unchanged under similarity transformation, that is, 
asymptotic stability is realization-independent. 



It is important to emphasize that stability is a system property: 

• This is true by construction for BIBO stability. 

• The above Proposition 7.1.1 and Theorem 7.1.3 proves it for the 
asymptotic stability of LTI systems. 



7.1.7 Relationship Between Asymptotic and BIBO Stability 

Generally speaking, asymptotic stability is a “stronger” notion than BIBO 
stability. This is because it is intuitively clear that a bounded state signal 
produces a bounded output signal through a smooth and bounded output 
function y = h(x). Therefore we expect that asymptotic stability implies 
BIBO stability under relatively mild conditions. 

The following theorem shows the relationship between BIBO and asymp- 
totic stability in the case of LTI systems. 

Theorem 7.1.4 (Asymptotic and BIBO stability of LTI systems). 

Asymptotic stability implies BIBO stability for LTI systems but the reverse 
statement does not hold. 

The following two simple examples show that a BIBO stable system is indeed 
not necessarily asymptotically stable. 
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Example 7.1.1 (Asymptotic and BIBO stability 1) 

A BIB O-stable but not asymptotically stable LTI system 



Consider a LTI system with the state-space representation 



'-2 O' 
0 3 


x + 


'2' 

l 




y = 


[10 



(7.20) 

(7.21) 



The system above is not asymptotically stable since one of the 
eigenvalues of the state matrix is positive, but it is BIBO-stable 
because the “unstable state” does not appear in the output. 

The above system is called non- detectable, since the unstable state 
is clearly non-observable. 



Example 7.1.2 (Asymptotic and BIBO stability 2) 

Another BIBO-stable but not asymptotically stable LTI system 



Consider an LTI system with the truncated state equation 



x 



1 -2 

2 0 



(7.22) 



The eigenvalue analysis shows that 



Ai,2 — +i 

that is, the poles of the system are on the stability boundary. This 
system is a pure oscillator. 



7.2 Local Stability of Nonlinear Systems 

One of the most widespread approach for analyzing local asymptotic stability 
of a nonlinear system in the neighborhood of a steady-state operating point 
is to linearize the system model around the operating point and then perform 
linear stability analysis. This approach is the subject of this section, where 
we discuss how to linearize nonlinear state-space models, how to relate local 
and global analysis results and how local stability depends on the system 
parameters. 
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7.2.1 Local Linearization of Nonlinear State-space Models 

In order to linearize a state or output equation in a nonlinear state-space 
model, we first need to find a steady-state operating or reference point to 
linearize around and then proceed with the linearization. 

The Reference Point. The reference point (uo,xo,yo) for the linearization 
is found by specifying a reference input uq for a nonlinear state-space model 
in its general form: 

x = f(x, u ), y = h(x, u) (7.23) 

and computing the reference value of the state and output signals from the 
above equations by specifying x = 0 to have a steady-state operating point: 

f(x 0 , U o) = 0, 2/0 = h(xo, U 0 ) (7.24) 



In the special case of input-affine state-space models, we have: 

m 

/(so) + y>(*oMo) = o, yo = h(x 0 ) (7.25) 

2 = 1 

from the state-space model 

m 

±{t) = f(x(t)) + '52g i (x(t))u i (t) 

2=1 

y(t) = h(x(t)) (7.26) 

Thereafter, centered variables are introduced for all variables to have 



X = U-U 0 , X = X~X 0 , y = y-y 0 



(7.27) 



The Principle of Linearization. The linearization is based on a Taylor- 
series expansion of a smooth nonlinear function / around a steady-state ref- 
erence point xq- 

In the case of a univariate (i.e. when x is scalar) scalar- valued function 
y = f(x), the following Taylor series expansion is obtained: 



/ 0 ) 



f( x o) + 



df_ 

dx 



{x 

xo 



X 0 ) + 



d 2 f (x - x 0 ) 2 

dx 2 2 ! 



(7.28) 



where Xo is the reference point and denotes the i-tli partial derivative of 
the function / with respect to x. 

The linear approximation is then obtained by neglecting the higher-order 
terms, which gives: 
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/(X) =* /(*>) + £ 



(x - X 0 ) 



(7.29) 



This way, we obtain a linear approximation of the original nonlinear equation 
y = f{x) in the form: 



„ , , df 
V = fM + dx 



(x - Xo) 



(7.30) 



The above equation can be simplified to obtain 



( y + yo ) = f(x 0 ,t) + ^ 



{x - x 0 ) 



(7.31) 



because 



Vo = /(x 0 ) and y = y - y 0 



(7.32) 



Finally we obtain 




x 



Xo 



(7.33) 



which is the final linearized form expressed in terms of the centered variable 

x. 

It is easy to extend the above formulae (7.33) for the case of a multivariate 
vector- valued function y = /(x i, . . . , x n , t) to obtain 

y=J f ' x \ Xo -x (7.34) 



where jf ,x is the so-called Jacobian matrix of the function / containing the 
partial derivatives of the function with respect to the variable x evaluated at 
the steady-state reference point 



jf,x 

J ji 



9fj 

dxi 



(7.35) 



The Linearized Form of the State-space Model. Now we can apply 
the principle of linearization to the case of nonlinear state-space models. To 
do this, the nonlinear functions / and h in the general state-space model 
in Equation (7.23) or the nonlinear functions /, g and h in Equation (7.26) 
can be linearized separately around the same steady-state reference point 
(u 0 ,x 0 , 2 /o). 

The linearized model can then be expressed in terms of centered variables 
in an LTI form: 

x = Ax + Bu 
y = Cx + Du 



(7.36) 
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where in the general nonlinear state-space model case the matrices can be 
computed as 



A = J f " 



, B = J S; 



, C= J h 



D=J 



(7.37) 



while in the input-affine case they are in the form: 
A= J 9 ’ x \ 0 u 0 , B = g(x 0 ), C = J h,x \ 



D = 0 



(7.38) 



7.2.2 Relationship Between Local and Global Stability of 
Nonlinear Systems 

The relationship between local and global stability is far from being trivial. It 
is intuitively clear that global stability is a stronger notion, that is, a locally 
stable steady-state point may not be globally stable. This is the case when 
more than one steady-state point exists for a nonlinear system. 

There is a related but important question concerning local stability of 
nonlinear systems: how and when can we draw conclusions on the local sta- 
bility of a steady-state point of a nonlinear system from the eigenvalues of 
its locally linearized state matrix? The following theorems provide answers 
to this question. 

Theorem 7.2.1 (Theorem for proving local asymptotic stability). 

Suppose that each eigenvalue of the matrix A in Equation (7.36) has a neg- 
ative real part. Then Xq is a locally asymptotically stable equilibrium of the 
original system (7.26). 

The following theorem shows how one can relate the eigenvalues of a locally 
linearized state matrix to the unstable nature of the equilibrium point. 

Theorem 7.2.2 (Theorem for proving instability). Suppose that the 
matrix A in (7.36) has at least one eigenvalue with a positive real part. Then 
Xq is an unstable equilibrium of the original system (7.26). 

The following simple examples illustrate the application of the above results 
to simple systems. 



Example 7.2.1 (Global and local asymptotic stability 1) 



We show that Theorem 7.2.1 is only true in one direction. For this 
purpose, consider the one-dimensional autonomous system 
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x = —a; 3 



(7.39) 



The only steady-state equilibrium of this system is £0 = 0. 

The Jacobiau matrix is now a constant Jf ,x = — 3x 2 evaluated at 
xo = 0, which is again 0. 

It’s easy to check that for any initial condition a;(0) 



x(t) = . v ' 

yj2tx( 0) 2 + 1 

From this, it follows that 

|x(t)| < |ar(0) | , Vi > 0 



(7.40) 

(7.41) 



and obviously 
lim x(t) = 0 



(7.42) 



Therefore 0 is a globally asymptotically stable equilibrium of the 
system (7.39). 



Example 7.2.2 (Global and local asymptotic stability 2 ) 



In this simple example we show that only stability of the linearized 
system is not enough even for the stability of the original nonlinear 
system. For this, consider the one-dimensional autonomous system 

x = — x 2 (7.43) 

It’s easy to see that the linearized system (around the equilibrium 
state x 0 = 0) reads 



x = 0 (7.44) 

which is stable (but not asymptotically stable). It can be checked 
that the solution of Equation (7.43) for the initial state x(0) is 
given by 
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I(,) = tejfff+l' Vt 2 0 < 745 > 

This means that 0 is an unstable equilibrium state of (7.43) since 
the solution is not even defined for all t > 0 if x(0) < 0. 



Example 7.2.3 (Asymptotic stability, nonlinear case) 



Consider the following two-dimensional model (which is the model 
of a mathematical pendulum with rod length l and gravity con- 
stant g) 

xi = X 2 (7.46) 

±2 = -y sin(xi) (7.47) 

It’s easy to see that this system has exactly two equilibrium points, 
namely Xoi = [0 0] T and X 02 = [tt 0] t . The system matrix of the 
linear approximation in X 02 is given by 



A = 



0 1 
A o. 



(7.48) 



which has an eigenvalue with a positive real part, therefore X 02 
is an unstable equilibrium of the system according to Theorem 
7.2.2. We can’t say anything about the stability of Xoi based on 
the linear approximation. However, it’s not difficult to prove with 
other methods that Xoi is a locally stable but not asymptotically 
stable equilibrium state. 



7.2.3 Dependence of Local Stability on System Parameters: 
Bifurcation Analysis 

Roughly speaking, bifurcations represent the sudden appearance of a quali- 
tatively different solution for a nonlinear system as some parameter varies. 
We speak about a bifurcation when the topological structure of the phase 
portrait of a dynamical system changes when a parameter value is slightly 
changed. 

Definition 7.2.1 (Topological equivalence) 

Let f : M R n and g : N i— > M" be class C r mappings where M, N C R n 
are open sets, and consider the autonomous systems 
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x = f(x) (7.49) 

x = g(x) (7.50) 

with flows existing for all ( € K. The two differential equations (7.)9) and 
(7.50) are topologically equivalent if there exists a homeomorphism 
h : M i— > N that transforms the trajectories of Equation (7.f9) into the 
trajectories of Equation (7.50) keeping the direction. 

If Equation (7.49) and Equation (7.50) are topologically equivalent, then h 
maps equilibrium points onto equilibrium points and periodic trajectories 
onto periodic trajectories (by possibly changing the period). 

In order to define bifurcation values, consider a parameter-dependent un- 
forced nonlinear system 

x = f(x, e), x £ M, e € V (7.51) 

where M C R" and FcR 1 are open sets and f : M x V i— > R" is a class 
C r function. Notice that Equation (7.51) can be also be interpreted as a 
parameter-independent system x = f(x, e), i = 0. We assume that (7.51) has 
a solution on the entire set R, and /( 0, 0) = 0. 

Definition 7.2.2 (Bifurcation value) 

The parameter e = 0 £ V is called a bifurcation value if in any neighborhood 
of 0 there exist e £ V parameter values such that the two autonomous systems 
x = fix, 0) and x = /( x, e) are not topologically equivalent. 

Besides characterizing bifurcation points, Theorem 7.2.3 below can also be 
used for investigating local stability based on the eigenvalues of the linearized 
state matrix with multiple zero eigenvalues. 

Let Ai, . . . A s be those eigenvalues of the linearized system matrix A that 
have zero real parts, where 

n 

(7.52) 

*>j=i 

Furthermore, let A have exactly m eigenvalues with negative real parts and 
k = n — s — m eigenvalues with positive real parts. 

Theorem 7.2.3 (Center manifold theorem). In a neighborhood of 0 with 
e of a sufficiently small norm, the system (7.51) is topologically equivalent 
with the following system: 

x = F(x, e) := Hx + g(x, e) 

y = -y (7.53) 

z = z (7.54) 

where x(t) £ R s , y(t) £ R m , z(t) £ R fc and H is a quadratic matrix of size 
s with eigenvalues Ai . . . X s . Furthermore, g is a class C r function for which 
g( 0, 0) = 0 and D x g( 0, 0) = 0. 



A = D x f{ 0,0) = 






dxj 
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From the construction of Equation (7.53), it follows that in a neighborhood 
of 0, the bifurcations of Equation (7.51) can be described using only the 
equation 

x = F(x,e) (7.55) 

Equation (7.55) is called the reduced differential equation of Equation (7.53) 
on the local center manifold Mf oc = {(a;, y, z)\y = 0,2; = 0}. 

Often, Equation (7.55) can be transformed into a simpler ( e.g . polyno- 
mial) form using a nonlinear parameter-dependent coordinate transformation 
which does not alter the topological structure of the phase portrait in a neigh- 
borhood of the investigated equilibrium point. This transformed form is called 
a normal form. The normal form is not unique, different normal forms can 
describe the same bifurcation equivalently. 

Definition 7.2.3 (Fold bifurcation) 

Let / : t x 8 fe a one-parameter C 2 class map satisfying 





/( 0 , 0 ) 


= 0 


(7.56) 


'df 

dx_ 


e— 0,:r=0 


= 0 


(7.57) 


\d 2 .f 

dx 2 _ 


e=0,tc=0 


> 0 


(7.58) 


'df 

de 


e=0,£=0 


> 0 


(7.59) 



there then exist intervals (ei,0), ( 0 ,e 2 ) and p > 0 such that: 

• if e £ (ei,0), then /(-,e) has two equilibrium points in (—p,p) with the 
positive one being unstable and the negative one stable, and 

• if e £ ( 0 , 62 )) then /(-,e) has no equilibrium points in (— p,p). 

This type of bifurcation is known as a fold bifurcation (also called a saddle- 
node bifurcation or tangent bifurcation). 



7.3 Lyapunov Function, Lyapunov Theorem 

The Lyapunov theorem and the Lyapunov function, the existence of which 
is the condition of the theorem, play a central role in analyzing asymptotic 
stability of nonlinear systems. This is the most widespread and almost the 
only generally applicable technique for this case. 

7.3.1 Lyapunov Function and Lyapunov Criterion 

The concept of a Lyapunov function originates from theoretical mechanics. 
Here we see that in stable conservative systems “energy” is a positive definite 
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scalar function which should decrease with time. Using this analogy, we can 
define a generalized energy as a Lyapunov function to analyze stability for 
any nonlinear system. 

Definition 7.3.1 (Lyapunov function) 

A generalized energy or Lyapunov function V[x] to an autonomous system 
with a truncated state equation x = f{x ) is a scaler-valued function with the 
following properties: 

1 . scalar function 

V : R" -> R. 



2. positive definiteness 



V[x(t)} > 0 



3. dissipativity 



dt 



V[x(t)] 



dV d[x(t)\ 
dx dt 



Note that the system dynamics is buried in the inequalities above, because 
both the positive definiteness and dissipativity is required along every possible 
trajectory in the state-space. 

Theorem 7.3.1 (Lyapunov). A system S is asymptotically stable (in the 
strong sense) if there exists a Lyapunov function with the above properties. 



Note that the Lyapunov criterion above is not constructive: it is the task of 
the user to find an appropriate Lyapunov function to show stability. More- 
over, the reverse of the statement is not true. 

Converse Lyapunov Theorem. While there is no general method of con- 
structing Lyapunov functions for nonlinear systems, the existence of Lya- 
punov functions for asymptotically stable systems is theoretically guaranteed 
by the following well-known theorem. 

Theorem 7.3.2 (Converse Lyapunov theorem). Consider the following 
autonomous system 



x = f(x) (7.60) 

where x € R", /( 0) = 0 , f is a smooth function on R"\{0} and continuous at 
x = 0. If the equilibrium x = 0 of the system is globally asymptotically stable, 
then there exists a positive definite and proper smooth function V : R" e- > R + 
such that 

f{x ) <0, Vx^O (7.61) 

Note that if the stability of the equilibrium is not global, then the above 
theorem can still be applied to an appropriate neighborhood of x = 0. 
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7.3.2 Lyapunov Criterion for LTI Systems 

The Lyapunov criterion is in a special “if-and-only-if’ form for LTI system 
as follows: 

Theorem 7.3.3 (Lyapunov for LTI systems). The state matrix A of 
an LTI system is a stability matrix, i.e. Re{Ai(A)} < 0 if and only if for 
any given positive definite symmetric matrix Q there exists a positive definite 
symmetric matrix P such that 

A t P + PA = -Q (7.62) 



Note that Q can be positive semi-definite if the system is observable. 

Proof. In order to show that the condition (7.62) is necessary, we define the 
generalized energy function of the system with realization ( A , B , C) as 

V[x(t)} = x T Px > 0 (7.63) 

with P being positive definite. 

It is now enough to show that the second Lyapunov property holds by 
computing the derivative 

~rV[x(t)\ = ^-(x T Px) = X T Px + X T Pi 
dt dt 

If we substitute the system equation x = Ax for (A, 0, 0) in the equation 
above with x T = ( Ax) T = x T A T , we get 

x t A t Px + x T PAx = x T {A T P + PA)x = x T {— Q)x 

A T P + PA is negative definite if and only if Q is positive definite. For ob- 
servable systems we can choose Q = C T C. 

The proof of the reverse direction is done by showing that if A is a stability 
matrix then 




where Q is the given positive definite symmetric matrix, will satisfy A T P + 
PA = -Q. 

The following example illustrates the above theorem for a simple LTI 
system: 
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Example 7.3.1 (Lyapunov theorem for an LTI system) 

Lyapunov theorem for a simple LTI system 

Consider the following matrix: 



If possible, compute P from Equation (7.62) with 



Q 



12 2 
2 4 



Since A is a stability matrix (Ai = —3, A 2 = — 1, Re(A;) < 0) and 
Q is positive definite (has positive eigenvalues), there is a positive 
definite symmetric matrix P to fulfill Equation (7.62). Searching 
for P in the form 

p= \pii P12 
P21 P22 _ 

using the fact that p\2 = P21, we need to solve a linear set of 
equations to obtain the solution for P : 



P = 



2 1 
1 3 



Quadratically Stabilizable Systems. Note that we can try to apply the 
quadratic Lyapunov function (7.63) to any nonlinear system. For some non- 
linear systems one can find a quadratic Lyapunov function V ( x ) = x T Qx 
with a suitably chosen Q. This gives rise to the definition below. 

Definition 7.3.2 (Quadratically stabilizable systems) 

A system is called quadratically stabilizable if there exists a static state feed- 
back such that the closed-loop system is asymptotically stable with a quadratic 
Lyapunov function. 



7.3.3 Lyapunov Criteria for LPV System Models 

LPV system models have been introduced in Section 3.4 as mild extensions 
of LTI systems with varying parameters. The truncated version of an LPV 
state equation (see Equation (3.12)) used for asymptotic stability analysis is 
as follows: 



x(t ) = A(0(t))x(t) 



(7.65) 
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where the state matrix A{9) is a function of a real-valued (possibly time- 
varying) parameter 9 = [9\, . . . ,9k] T from a bounded domain 6 £ 0. 

If we look at LPV systems as being linear systems then we can expect 
them to be quadratically stabilizable with a suitable quadratic Lyapunov 
function 

V{x) = x T Kx 

where K = K T > 0 is a symmetric positive definite matrix. 

Definition 7.3.3 (Quadratic stability of LPV systems) 

An LPV system with the truncated state equation (7.65) is said to be quadrat- 
ically stable for perturbations 0 if there exists a matrix K = K T > 0 such 
that 

A(9) t K + KA(9) < 0 

for all perturbations 9 £ O. 

If we further assume that the state matrix A(9) of the LPV system varies in 
a convex matrix polytope with corner-point matrices 

{Ai, A 2 , . . . , Ak) 

such that 

k k 

A(9(t)) £ = Co{A 1 , A 2 , ■ • ■ , A k } := ajAj : a* > 0 , ^ cq = 1} 

i — 1 i — 1 

then a necessary and sufficient condition can be given for such a polytopic 
LPV system to be quadratically stable. 

Theorem 7.3.4 (Quadratic stability of polytopic LPV systems). If 

the LPV system (7.65) is a polytopic parameter- dependent model where 
71(6*) G Co{Ai , . . . , Ak} for all 9 £ 0, then it is quadratically stable if and 
only if there exists K T = I\ > I such that 

AjK + KAi < 0 

for all i = 1 , . . . , k. 

7.4 Stability of Process Systems 

The asymptotic stability of process systems can be analyzed in three princi- 
pally different ways depending on the process system in question: 

• local asymptotic stability analysis can be performed after local linearization 
by investigating the eigenvalues of the resulting LTI state matrix A, 

• structural stability analysis can be performed using the method of conser- 
vation matrices (later in Section 7.4.2), 

• global nonlinear stability analysis can also be performed applying the Lya- 
punov theorem based on passivity analysis (see later in Section 8.5). 
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7.4.1 Structural Stability 



The notion of structural dynamic properties relies on the concept of structure 
matrices of a dynamic state-space model. 



Definition 7.4.1 (Structure matrix) 

A structure matrix [Y] of a real matrix Y is a matrix with structural zeros 
( denoted by 0) and structural non-zeros ( denoted by x) in its elements such 



that 



[Yh 



0 if Yij = 0 
x otherwise 



We may need to have the sign of the elements in the structure matrices, too. 
Signed structure matrices defined below serve this purpose. 

Definition 7.4.2 (Signed structure matrix) 

A signed structure matrix {F} of a real matrix Y is a matrix with structural 
zeros (denoted by 0) and signs (denoted by — and +) in its elements such 
that 

r 0 if Yij = 0 
{Y} ZJ = {+ if Yij > 0 
{ if Yij< 0 

The concept of structure matrices gives rise to recognition of classes of process 
models with the same structure and therefore similar dynamic properties. 

Definition 7.4.3 (Structurally equivalent state-space models) 

Two linear or linearized LTI systems with state-space representation matrices 
( A,B,C ) and (A' , B' ,C') are structurally equivalent if they give rise to the 
same set of signed structure matrices, i.e. 

{A} = {A'}, {B} = {B'}, {C} = {C'} 



With the notion of structurally equivalent state-space models we can say that 
a structural property holds for a class of structurally equivalent state-space 
models if it holds for almost every member of the class (with the exception 
of a zero-measure sub-class). This way we can define structural stability as 
follows: 

Definition 7.4.4 (Structural stability) 

A class of structurally equivalent state-space models is structurally asymp- 
totically stable if almost every member in the class (with the exception of a 
zero-measure sub-class) is asymptotically stable. 

The following example illustrates the notion of structural stability of a class 
in relationship to the stability of the members in the class. 
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Example 7.4.1 (Structural stability) 

A simple structurally stable class 

Let us consider the following state structure matrix {A} defining 
a structurally equivalent LTI state-space model class: 



{A} = 




(7.66) 



The following two matrices are different numerical realizations of 
the above structure matrix: 



A i 



-2 0 
0 -3 ’ 



A2 



— 0.05 0 

0 -1000 



It is easy to see that both A\ and A 2 are stability matrices, there- 
fore the LTI systems they belong to are asymptotically stable. 
On the other hand, every diagonal matrix with negative elements 
in its main diagonal is a stability matrix, because such matri- 
ces contain their real negative eigenvalues in their main diagonal. 
Therefore the whole LTI state-space model class defined by {A} 
is structurally asymptotically stable. 



7.4.2 Conservation Matrices 

Conservation matrices are special stability matrices often obtained as state 
matrices for dynamic process models. Their stability property is used for 
proving structural stability of a class of process systems where the class mem- 
bers have a locally linearized state matrix with conservation matrix property 
irrespectively of the system parameters. 

Definition 7.4.5 (Conservation matrix) 

A real square matrix F = of order n is said to be a column conser- 

vation matrix (or a row conservation matrix) if it is a matrix with dominant 
main diagonal with respect columns (or rows), i.e. 

\fu\>^2 \fij\ = R i, « = 1, 2, ...,n (7.67) 



or 



\fii\>Y,\fji\= C i» * = (7.68) 

iAi 

and its elements have the following sign pattern: 



fa < 0, fij > 0 , i ± j 



(7.69) 
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In the case of proper inequality for every inequality in either Equation (7.67) 
or (7.68), F is said to be a a strict column conservation matrix or a strict 
row conservation matrix. 

Conservation matrices are nonsingular and stable matrices [77], i.e. the real 
part of their eigenvalues is strictly negative for strict conservation matrices 
or non-positive otherwise. 



7.5 Process System Examples 

This section is devoted to showing how asymptotic stability analysis and 
structural stability analysis can be applied to process systems. 

7.5.1 Stability Analysis of the Free Mass Convection Network 

In this subsection we analyze the asymptotic stability of the free mass con- 
vection network described in Section 4.2.4 using the method of conservation 
matrices. The analysis is performed in two steps as follows: 

1. First, we show that the convection matrix C conv given by Equation (4.18) 
is a column conservation matrix. 

2. Then we prove that the matrix product C conv JC in the state equation 
(4.22) is also a column conservation matrix with 

/C = diag[ k w \ j = 1,...,C] 

being a diagonal matrix with positive elements. 

With the program above, the analysis results are as follows: 

1. We check the properties of conservation matrices for this case starting 
with the sign-pattern property and then investigating the dominant main 
diagonal property. 

• The sign pattern of the convection matrix C conv given by Equation 
(4.18) is easy to check. As ad 1 is a ratio for which 0 < (xf' 1 < 1 holds, 
the convection matrix possesses the required sign property, that is, 

[C CO nv\ii = -(1 - af) < 0 

[Cconv\ij = cq (j) > 0 

• The column-wise dominant main diagonal property is shown by using 
the defining Equation (4.16) for the flow ratios written in the form for 
the j-th column: 
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C 

Y &P + a^p + a,P = 1 
*= 1 . 

(?) 

Rearranging the equation and leaving out the non-negative term Og , 
we get 

*= 1 , 

which is exactly the inequality we wish to have. 

2. Let us compute first the elements of the matrix C conv K, from their defi- 
nitions to obtain 

— (1 — aP ... aP 

C conv IC= ... (7.70) 

aP aP k( 2 ) ... — (1 — ap)K^ 

It can be seen that the matrix product C conv K, is obtained from C conv in 
such a way that each of the columns of index j is multiplied by a positive 
constant different for each column. Therefore both the sign property 
and the dominant main diagonal property remains unchanged, that is, 
the matrix C conv K. is also a column conservation matrix and as such is a 
stability matrix. 



7.5.2 Lyapunov Function of the Free Mass Convection Network 

As another technique for asymptotic stability analysis, we now construct 
a Lyapunov function for the LTI state-space model of the free convection 
network given in Equation (4.22). 

First, we observe that the free mass convection network is a linear time- 
invariant system based on the state equation (4.22) with the following state 
and input variable vectors: 

x FC = M, u F c = Vin 



and state matrix 

Afc = C conv K. 

Therefore any function of the form 

VFc[XFc(t)\ = X T FC PXFC 



with P being a positive definite symmetric matrix, which is a solution of the 
equation 

■^fcP + PApc — — Q 

with Q being a positive definite symmetric matrix, is a Lyapunov function 
for the free mass convection network as is stated by Theorem 7.3.3. 

Let us choose the simplest case when Q = I then 

p = ~ (^FC + Ape) 1 
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7.5.3 Structural Stability Analysis of Heat Exchanger Networks 



We construct the dynamic process model of a heat exchanger network from 
sub-models of heat exchanger cells. Heat exchanger cells have been already 
introduced with their lumped process model developed in Section 4.4 before. 
Engineering Model of a Heat Exchanger Cell in the Network. Recall, 
that a heat exchanger cell is a pair of regions connected by a heat-conducting 
wall. Assuming constant mass and constant physico-chemical properties in 
each balance volume, the engineering model of the j-th balance volume con- 
nected to the f-th one forming jointly a heat exchanger cell is the potential 
form of the energy conservation balance equation for the temperature of 
the balance volume: 

^ - ^U) V U) T U) + 7 U) v U) T U) + K^l fer (TW - T«) (7.71) 

where K[ J r ’ansfer > 0 is a constant transfer coefficient. Notice that only con- 
vective transport and a transfer term are present in the equation above, which 
can be seen as a generalized form of the intensive form conservation balances 
in Equations (4.47)-(4.48) with 



ry(j) 



1 

E<j) ’ 



jAi/) _ 
transfer 



yW 



State Matrix of the Heat Exchanger Network. The set of state vari- 
ables of the overall heat exchanger network is the set of temperatures in the 
cells, i.e. 



A = (J T u) 
jec 



(7.72) 



where the number of the balance volumes is C = 2 N, and N is the total 
number of heat exchanger cells in the heat exchanger network. 

Let us rearrange the indices of the balance volumes forming the overall 
heat exchanger network so that the pair forming a heat exchanger cell are 
assigned indices next to each other, i.e. £ = j+ 1. Moreover, let us assume gen- 
eral connections between the cells described by Equations (4.17) and (4.16) in 
Section 4.2.4. Then the convective transport A Econv and transfer A Etrans ^ er 
state matrices forming the linearized state matrix A by 

j^Econv _|_ j^Etransf er ’jQ'j 



are in the following form: 



j^Etransfer 



— iff 1,2 ) 

transfer 

transfer 



Zfi 1 ’ 2 ) 

transfer 

— A*- 1 ’ 2 -* 

transfer 



o 

o 



0 

0 



n _t^{ 2N-1,2N) jy-(2N—l,2N) 

v transfer v transfer 
n rf(2N-l,2N) _rf(2N-l,2N) 

u 1 transfer v transfer 
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r a {1) 

a d 


a od ■ 


ViAOl 

a od 


j^Econv 


A2,l) 

a od 


a {2) 

a d 


4(2, AO 
•• a od 




4 (JV>1) 
L a od 


A (n ’ 2) 
a od ■ 


1 

: 5 .Q 



(7.74) 



where the diagonal blocks in the convective matrix term are 



A (J) _ 
a d ~ 



— j ( j ) v ( j)(i _ a ^) 
7 0'+i) w 0'+i) a 0'+ 1 ) 



- y 0 ') U 0') Q! ^ 1 
_»yO' + 1 ) U (j + 1 )(l — a 



0’+i)\ 

'3 ’ 



(7.75) 



Note that the diagonal blocks above are usually diagonal matrices because 
the convective connection between the cold and hot side of the same heat 
exchanger cell is a rare exception. Furthermore, the off-diagonal blocks 
have elements being equal either to 0 or to a connection term -yCdi 
where £ = ior£ = i+l. 

It is easy to see from the equations and matrices above that the convective 
transport state matrix A Econv is a row conservation matrix while the transfer 
state matrix A Etrans f er is a diagonal matrix with negative entries, therefore 
the overall state matrix is also a row conservation matrix acting as a stabil- 
ity matrix. It implies that heat exchanger networks with constant mass and 
constant physico-chemical properties in each balance volume are structurally 
asymptotically stable [34]. 



7.5.4 Structural Stability Analysis of a Binary Distillation 
Column with Constant Molar Flow and Vapor-liquid Equilibrium 

The elementary engineering unit of a distillation column is a real or theo- 
retical distillation tray which is a two-plrase perfectly mixed subsystem with 
vapor and liquid phases. In the case of binary distillation, the composition of 
the binary mixture can be characterized by one mole fraction ( e.g . the mole 
fraction of the more volatile component) in both the liquid (£) and the vapor 
( 77 ) phases. The simple evaporator shown in Figure 4.1 in Section 4.3.2 can 
be regarded as a simple distillation tray. 

Constant molar flows F for the liquid and V for the vapor phase are 
assumed with Hl being the liquid phase and Hy is the vapor phase molar 
hold-up both of them are constants - on the tray. 

Engineering Model of a Distillation Tray. If vapor-liquid equilibrium 
can be assumed on each tray and the vapor phase hold-up is negligible com- 
pared to the liquid phase hold-up, then the liquid and vapor phases of a tray 
form a balance volume in the dynamic model of the column with the liq- 
uid phase as the dynamic one. Moreover, because of the constant molar flow 
conditions, only the component conservation balance equation for the mole 
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fraction of the more volatile component need be considered together with 
the equilibrium relationship. Therefore the original DAE model equations 
(4.25)-(4.45) specialize to the following set of differential equations: 

Hl^- = L{^ +1) - £ (i) ) + - t ] (i) ) (7.76) 

r] {j) = V(C (i) ) (7.77) 

where 



r u) _ gy« 0) ) 

d £«> 



(7.78) 



for the j-th tray, i.e. for the j'-tlr balance volume. 

State Matrix of the Distillation Column. The set of state variables of 
the binary distillation column with constant molar flows is the set of liquid 
phase mole fractions on the trays, i.e. 



X = U Z U) 

j&c 



(7.79) 



where the number of the balance volumes is C = N, and N is the number of 
the trays. 

Substituting Equation (7.77) into the conservation balance equation 
(7.76) and linearizing the equations around the steady-state equilibrium 
points on the trays, the following state matrices result: 



j^Econv 



H l 

o 

0 



L 




Hl 



0 

L 

H l 



0 



0 



0 ■ 

0 

0 

L L 
H l Hl 
n 1 



(7.80) 



j^Etransfer 



v_ r(i) 

Hl 1 

XrP) 

Hl 1 



0 



0 



00 ... 0 

-Tk r{2) 0 • 0 

0 

v_p( N ~i) o 

Hl Hl 

V p(N) V p(N) 

H l 1 Hl 1 

(7.81) 



It can be seen from the matrices above that they are both row conser- 
vation matrices, therefore the binary distillation column with vapor-liquid 
equilibrium is structurally locally asymptotically stable [34], 
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7.5.5 Structural Stability of a Binary Distillation Column with 
Constant Molar Flows in the Non-equilibrium Case 

If equilibrium on the trays cannot be assumed, then another dynamic equa- 
tion describing the component transport in the vapor phase should be con- 
sidered instead of the equilibrium relationship (7.77). Therefore two balance 
volumes are needed to describe the behavior of a tray, one for the liquid and 
one for the vapor phase. The transfer between the phases is described by 
transfer rate expressions. 

Engineering Model of the Distillation Tray. Because of the molar flow 
conditions, only the component transport equations for the mole fraction of 
the more volatile component in both phases have to be considered together 
with the equilibrium relationship 

Hl ^ + k% ransfer (d j) - £ (i) ) (7-82) 

Hv ~fj~ = - V W ) + kv transfer {vi e) - V W ) (7-83) 

= V(d j) ) (7.84) 

with the usual non-negativity condition (7.78) for the j - th liquid phase and 
for the t - th vapor phase balance volumes on the tray and with 



d/ti) _ i,U) (Aj) 

^ transfer n ' Ltransfer\ 



cU)\ _ _i.W (J, 1 ) 

S / ”'Vtransfer\ I* 



(7.85) 



State Matrix of the Distillation Column. The set of state variables of 
the distillation column is the set of mole fractions in the liquid and vapor 
phase of the trays, i. e. 



* = (U^)U(lh 0) ) 

iejv jeJV 



(7.86) 



where the number of balance volumes is C = 2 N, and N is the total number 
of trays in the column. 

Let us rearrange the indices of the balance volumes forming the distillation 
column so that the pair forming a tray is assigned neighboring indices, i.e. 
£ = j + 1. Moreover, let us assume that the mixture forms no binary azeotrope, 
therefore 



AhA _ u(j) r,(^d) _ uW p(j,A _ pU) 

^ transfer n 'Ltransfer'> ^ transfer transfer’ 



(7.87) 



Substituting Equation (7.84) into the conservation balances in Equations 
(7.82) and (7.83) and linearizing the equations around the steady-state equi- 
librium points on the trays, the following state matrices result: 
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j^Econv 



H l 

o 

0 

0 

0 



0 

V 

Hv 

0 



L 

Hl 

0 



0 

0 



0 

0 



0 

V 

Hv 



0 

0 

0 

L 

Hl 

0 



0 ■ 
0 
0 
0 



AC 

Hy -I 



(7.88) 



j^Etransfer 



K ,2) 

0 



( 1 . 2 ) 

2 

( 2 , 1 ) 



0 



0 ... 0 

0 ... 0 

0 

n (5 (2W-l,2AT) H2N-1,2N) 
u V 2N-1 *2iV 

H2N,2N-1) H2N,2N-1) 
■■■ V 2N-1 ^2N 



(7.89) 



It can be seen from the matrices above that they both are row conserva- 
tion matrices, therefore the binary distillation column with no azeotropes is 
structurally locally asymptotically stable [34]. 



7.6 Stability Analysis of a Simple Continuous Fermenter 

The example of a simple continuous fermenter described in Section 4.5.3 is 
used here to show how stability analysis methods can be used to determine 
local stability near an optimal steady-state operating point and how the 
stability region can be determined [76]. 

The nonlinear state-space model of the fermenter is given in Equations 
(4.78)-(4.79). The variables and parameters of the fermentation process 
model are collected in Table 4.1. 

7.6.1 Local Stability Analysis 

The linearized state-space model of the continuous fermenter is also developed 
in Section 4.5.3 and is given in Equations (4.84)-(4.87). 

A local stability analysis shows that the system is stable, within a neigh- 
borhood of the desired operating point, but because the point is very close 
to the fold bifurcation point 

(X*,S*,F*) = (4.8775,0.2449,3.2128) 

this stability region is very small. This is illustrated in Figure 7.2, which 
shows that the system moves to the undesired wash-out steady state when it 
is started from close neighborhood of the desired operating point 



A(0) = 4.7907y , 5(0) = 0.2187y 
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Figure 7.2. Open-loop behavior of the system 



7.6.2 Stability Analysis Based on Local Linearization 

The stability of the fermenter around the operating point depends upon the 
eigenvalues of the linearized state matrix A in Equations (4.84)-(4.87). These 
eigenvalues form a complex conjugated pair, in our case: 

A 12 = -0.6017 ± 0.5306i (7.90) 

We can see that the process is indeed locally stable around the operating 
point but the linear analysis does not provide any information on the extent 
of the stability region. 

7.6.3 Nonlinear Stability Analysis 

The nonlinear stability analysis is based on a Lyapunov technique which aims 
to find a positive definite scalar valued generalized energy function V (x) 
which has a negative definite time derivative within the whole operating 
region. Most often a general quadratic Lyapunov function candidate is used 
in the form of 

V(x) = x t Qx 

with Q being a positive definite symmetric quadratic matrix, which is usually 
diagonal. This function is scalar- valued and positive definite everywhere. The 
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stability region of an autonomous nonlinear system is then determined by the 
negative definiteness of its time derivative: 

dV dV . dV . 

W = 15 x = aV (l) 

where f(x) = /( x) in the open loop-case (assuming zero input) and fix) = 
f(x) + g(x)C(x) in the closed-loop case where C(x) is the static linear or 
nonlinear feedback law. 

The diagonal weighting matrix Q in the quadratic Lyapunov function is 
selected in a heuristic way: a state variable which does not produce over- 
shoots during the simulation experiments gets a larger weight than another 
state variable with overshooting behavior. In the new norm defined by this 
weighting, a more accurate estimate of the stability region can be obtained. 

With this analysis we cannot calculate the exact stability region but the re- 
sults provide valuable information for selecting the controller type and tuning 
its parameters. The nonlinear stability analysis results in the time derivative 
of the quadratic Lyapunov function as a function of the state variables, which 
is a two-variable function in our case as seen in Figure 7.3. The stability re- 
gion of the open-loop system is the region on the (aq,^) plane over which 
the function is negative. 



7.6.4 Stability Analysis based on an LPV Model 



In order to show how the extension of the Lyapunov technique for linear 
parameter-varying (LPV) systems can be applied to a nonlinear system, we 
consider again the simple continuous fermenter model developed in Section 
4.5.3 but we change the control input of the system to be the substrate feed 
concentration Sf- 

The state-space model of the system is then given by the following equa- 
tions: 



X = -^X + v(S)X 

FI F 

s = - v s - yn(S)x + v s F 



(7.91) 

(7.92) 



This can be written in LPV form as: 
d_ 
dt 



'X' 




r«5-£ 


0 




X 




' 0 ' 


S _ 


— 


l-yS 


F 
V - 




s 


+ 


F 

. V . 



Sf 



(7.93) 



where 6 = n{S) is now considered as a time-varying parameter of the system. 

Now we construct a quadratic Lyapunov function candidate in the form 
of V (x) = x T Px and choose the positive definite matrix P such that it fulfills 
the conditions in Theorem 7.3.4. 

Assume that 6 is bounded, i.e. it takes its values in a compact interval: 



S (E [0, [Xrnax\ 



(7.94) 
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Figure 7.3. Time derivative of the Lyapunov function of the open-loop system 
with Q = I 



The Lyapunov function of the simple continuous fermenter system model 
above has to fulfill the following linear matrix inequality (LMI) for any 5: 

\ v _Z P + P _ 1 Y _> <0 (7.95) 

where “<” means “negative definite”. 

Since the LPV model is affine in <5, it is enough to investigate its stability 
at the end points of the interval [58]: 

T-- 0 1 T-- 0 1 F 

« -§\ P + P [ 0 ^_ f J = - 2 -r<o (7.%) 



h^max y y t^vnax p i p H'max y 

0 -F + _T u 

V J y r tjrnax 

Assume that 
F 



F 

= - 2 -P<° 


(7.96) 


_ F 0 I 

V F <0 

"max y 


(7.97) 



Then P will be searched in diagonal form: 
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Pi 0 
0 P2 



(7.99) 



where Pi,P 2 > 0. 

Since P is positive definite, the first inequality in Equation (7.96) is always 
fulfilled. The second one in Equation (7.97) is in the following form: 



2(/Tmax y )Pl 

Y l^maxV 2 



Y l^maxP 2 




<0 



(7.100) 



This inequality is fulfilled if and only if its elements fulfill the following con- 
ditions: 

det(Mn) = 2 (p, max - —)pi < 0 (7.101) 

F F 1 

det(-M) = —4 (/j 

max y) V PlP2-( -y P'ma X P2) 2 > 0 (7.102) 

The first condition is always fulfilled if (7.98) holds, since p\ > 0. The second 
condition is fulfilled if p\ and p 2 are chosen as: 

4 Y 2 F ( F \ 

0 < P2 < ~2 77 ( 77 - Pm fix ) Pi = C Pi (7.103) 

Pmax r \ C / 



where c is positive according to the inequality in Equation (7.98). 
The above derivation shows that the function 



V(X,S) = Pl X 2 +p 2 S 2 (7.104) 

is a Lyapunov function of the LPV system (7.93), if the conditions in Equa- 
tions (7.98) and (7.103) are fulfilled. 



7.7 Further Reading 

The stability of linear systems is discussed in detail, e.g. in the excellent book 
[8] . [59] is a classical introductory book into the theory of Lyapunov’s direct 
method. For the more mathematically oriented readers, [54] contains a wide 
arsenal of stability investigation methods and examples as well as a large 
number of further references. 



7.8 Summary 

Based on the stability notions and analysis tools developed for LTI systems, 
the basic concepts and algorithms for analyzing local and global stability of 
input-affine nonlinear systems are described in this section. 

Besides the techniques that are based on linearized models and are suit- 
able for investigating local stability near a steady-state operating point, the 
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Lyapunov method as the main global stability analysis tool is introduced 
here. 

Structural stability analysis based on conservation matrices is also de- 
scribed in details. 

The stability analysis methods are illustrated using case studies of process 
systems of practical importance: heat exchangers, distillation columns and 
continuous fermenters. Their stability analysis is based upon their input- 
affine nonlinear state-space model developed in Chapter 4. 



7.9 Questions and Application Exercises 

Exercise 7.9.1. Compare the local and global asymptotic stability analysis 
methods and the results of the analysis. Comment on the similarities and 
differences. 

Exercise 7.9.2. What are the advantages and disadvantages of the method 
of conservation matrices in analyzing asymptotic stability of process systems? 

Exercise 7.9.3. Consider the following two-dimensional nonlinear system 
model in its input-affine state-space form (the same as in Exercise 6.9.4): 



= x 



1/2 3/2 



Xn — 



X\x\ 



1/2 



Ml 



dx 1 
dt 

= 3xix^ 2 — 2xfx2 
y = x\x\^ — x^ 2 x\ 

Linearize the system model around a steady-state operating point. 



Exercise 7.9.4. Consider the two-dimensional nonlinear system model above 
in Exercise 7.9.3. 

Perform local stability analysis of the system using the state matrix A of 
the linearized system model around a steady-state operating point. (Use the 
result of Exercise 7.9.3.) 



Exercise 7.9.5. Consider the following simple nonlinear truncated system 
model 

x = x(A + ax) 

on the open domain x > 0 with parameters a > 0, A > 0. 

Show that the function 

V(x) = c [x — x* — x* In 

is a Lyapunov function of the system with any c > 0 and c* > 0 being the 
steady-state reference point of the system. 
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Exercise 7.9.6. Perform linear stability analysis of the nonlinear heat ex- 
changer cell described in Section 4.4.4 using its linearized state-space model 
developed in Exercise 4.8.10. 

Exercise 7.9.7. Perform structural stability analysis of the passive mass 
convection network described in Section 4.2.4. 

Exercise 7.9.8. Analyze global stability of the passive mass convection net- 
work described in Section 4.2.4 using the Lyapunov function technique. 




8. Passivity and the Hamiltonian View 



Passivity and the Hamiltonian view on nonlinear systems were originally 
developed for mechanical systems and have proved to be useful in analyzing 
stability and designing stabilizing controllers. It is, however, possible and 
useful to extend these notions to other systems including process systems, 
and this is the subject of this chapter. 

Passivity theory and the Hamiltonian view on nonlinear input-affine sys- 
tems in general and on nonlinear process systems in particular are described 
here in the following sections: 

• The storage function and its properties 

This section contains the mathematical definition and properties of the 
storage function together with its connection to the stability notions. 

• Passivity conditions and asymptotic stability 

The definition of passive systems and the relation of passivity with Lya- 
punov’s theorem on asymptotic stability is given here. 

• The Hamiltonian view 

The Hamiltonian function is introduced as a general energy function using 
a mechanical analogy. The Euler-Lagrange equations are also developed 
and a relation between state and co-state variables are given. 

• Affine and simple Hamiltonian systems 

An important special class of Hamiltonian systems, the so-called simple 
Hamiltonian systems, is introduced here for later use. 

• Passivity theory for process systems 

The passivity theory is extended here for process systems. The storage 
function of process systems is given with its thermodynamical interpreta- 
tion. Using the notion of passivity, a class of passive process systems is 
identified. 

• The Hamiltonian view on process systems 

The Hamiltonian function is introduced for process systems and the ther- 
modynamical meaning of the state and co-state variables is given based on 
the mechanical analogy. 

• Comparing passivity-based and Hamiltonian description 

The two approaches available for describing nonlinear process systems are 
compared with respect to the modeling assumptions they require and the 
possibilities they offer for dynamic analysis. 
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• Process system examples 

Simple process system examples including a heat exchanger cell, a pas- 
sive mass convection network and a simple unstable CSTR are given to 
illustrate the use of the tools and techniques introduced in this chapter. 



8.1 The Storage Function and its Properties 

The notion of L2-gain of nonlinear systems introduced in Subsection 7.1.3 
gives rise to the notion of available storage and then to the storage function. 
We recall that the notion of L2-gain is related to BIBO stability and it is 
an extension of the finite gain concept for LTI systems. For the purpose of 
defining the storage function of a system, Equation (7.6) will be rearranged 
as follows: 

Definition 8.1.1 (Available storage) 

For all x € A4, define the available storage V a : M. — > R + as: 

V a (x(T)) = sup* / (-\\yf + ^\\ u \\ 2 )dt, u € £ 2 [0,T] , T > 0 (8.1) 

u ^ Jo 

given a;(0) = xo and 7 € R. 

Observe that the defining equation above originates from Equation (7.6), 
which is regarded as the extension of the finite gain property to nonlinear 
systems with y 2 being the static gain. In this context, V a {.) is seen as a 
supremum of the non-unique functions K(.) given y 2 > 0. 

Definition 8.1.2 (Storage function) 

The function V : M. — > R + is called a storage function if the integral dissi- 
pation inequality is satisfied for any t > to ■' 

V( x (t)) - V(x(t 0 )) < ^ (7 2 |M| 2 - M 2 ) dr, T(0)=0 (8.2) 

for all t > to and u G C- 2 [toP] with initial condition x{t 0) and fixed to- 

Note that the storage function is not unique for a given system. Moreover, 
E(.) depends on the constant 7 and on the choice of the input function u. 

The integral on the right-hand side of inequality (8.2) represents the net 
“energy” feed into the system, that is, the difference between the feed at the 
input and the loss at the output. If we regard V(x{t)) as the energy content 
of the system at any time t,, then its change over the interval [fi, t-f is less 
than or equal to the net “energy” fed to the system if there is no internal 
energy source. 
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8.2 Passivity Conditions and Asymptotic Stability 



This section shows how the above introduced storage function relates to 
asymptotic stability of a nonlinear system. 

Definition 8.2.1 (Dissipative (passive) system) 

The system is called dissipative (passive), with respect to the supply rate 
i(7 2 ||'u|| 2 — ||y|| 2 ), if the above storage function in Definition 8.1.2 exists. 

Again, the definition above clearly depends on the constant 7 and on the 
choice of the input function u. 

Using the above concepts, we can easily arrive at the famous Hamilton- 
Jacobi inequality. First, we differentiate Equation (8.2) with respect to t and 
use the fact that we have a nonlinear system in input-affine form with 
x = f(x) + g{x)u : 

V x (x)f(x) + V x (x)g{x)u < ^7 2 |M| 2 - \h \\ 2 , U(0) = 0 (8.3) 



for all u G R m . Here V x = grad V is regarded as a row vector. Observe that 
the right-hand side of the above inequality is in the form: 



?,7 2 IMI 2 - ^IMI 2 = \ uTu - \v T y 

We then substitute the output equation y = h(x) into Equation (8.3) and 
perform the “completion of the squares” to get 



1 



1 



1 



V x (x)f(x) - -7 (u- ~g (. x)V x (a;)) (u--^g {x)V x (x)) 

+ \ ^Vx(x)g(x)g T (x)Vj(x) + hi T (x)h{ x) < 0 
The above equation shows that the maximizing input is equal to 
u* = Z,g T (x)Vj 



(8.4) 



(8.5) 



which permits us to obtain the supremum of the inequality (8.3). ft is impor- 
tant to note that the maximizing input u* is in the form of a static nonlinear 
full state feedback (see later in Chapter 9). 

Finally, we substitute the maximizing input to Equation (8.4) and obtain 
the final form of the Hamilton- Jacobi inequality: 

V x {x)f{x) + \ 1 ^V x (x)g(x)g T (x)Vj (x) + \h T (x)h( x) < 0 (8.6) 

z 7 Z Z 

U(0) = 0, X G M 

Observe that the above equation relates the time derivative of the storage 
function with the gain condition under closed-loop conditions where we gen- 
erate the maximizing input by a full, generally nonlinear, state feedback in 
Equation (8.5). 
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It follows from the definition of dissipative systems that the Hamilton- 
Jacobi inequality holds for dissipative systems controlled by the maximizing 
input. This means that we can check the dissipativity condition by checking 
the Hamilton- Jacobi inequality by using a candidate storage function V{x). 
Also, we may try to use the inequality to construct a storage function for a 
given nonlinear system by solving it for V x . 

8.2.1 Lyapunov Functions and Storage Functions 

There is a close connection between asymptotic (internal) stability of an 
input-affine nonlinear system described by the state-space model in Equation 
(7.5) in the form 



x = f(x) + g{x)u u £ M m , /( 0) = 0 

y = h(x) y £ R p , h( 0) = 0 

and the finiteness of To see this we recall that for passive systems 

j t v i x ) ^ \h 2 W u Wl ~ WvWl) 

This means that the nonlinear system has a finite gain locally at each x, i. e. 
every time. As the supply rate is related to the local finite gain, this implies 
that the time derivative of the storage function is negative every time. 

The storage function can then serve as a Lyapunov function [35]. The 
definition of the storage function implies that the storage function is positive 
definite and its time derivative is negative definite assuming that the supply 
rate is always non-negative (see Equation (8.2)). 



8.3 The Hamiltonian View 

The notion of Lagrangian and Hamiltonian systems (see, e.g. [80]) has been 
abstracted from the principles of theoretical mechanics when it has become 
clear that the underlying physics determines a strong special nonlinear struc- 
ture which can be utilized effectively in nonlinear systems and control theory. 

This section introduces the basic notions of the Hamiltonian description of 
nonlinear systems. The Hamiltonian view on both open-loop and closed-loop 
systems gives a relation between optimality, state and co-state variables. The 
relationship between the Hamiltonian description and the other tools and 
techniques applicable for input-affine nonlinear systems is also discussed. 

8.3.1 Storage Function and the Hamiltonian View 

It is possible to relate the above storage function concept in Section 8.1 to 
the Hamiltonian view. Equation (8.3) can be written as 
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Kry (x, Vj(x), u) < 0, V (0) = 0 for all u (8.7) 

where K 1 is defined as 

Kj(x,p, u) = p T f(x) + p T g(x)u - )p 2 \\u\\ 2 + \h T (x)h(x) (8.8) 

where p T = (pi . . . . ,p n ) = V x denotes the so-called co-state variable. The 
following equivalent form 

K 7 (x,p, u) = p T x - ^(7 2 u T u - y T y ) = dV ^ - ^(7 2 u T u - y T y) (8.9) 

shows that the function AT, at any time t gives the difference between the 
differential stored energy (the first term) and the supply rate. 

The function K 7 will serve as the Hamiltonian for both open-loop and 
closed-loop systems. Observe that A' 7 depends on the gain y 2 and the choice 
of the input, too. It is also important (see Equation (8.7)) that the Hamilto- 
nian is negative definite for dissipative (passive) systems. 

First, we examine the case of the supremum of the above function. Sub- 
stituting the maximizing input 

u* = \ g T {x)p (8.10) 

7 

into Equation (8.8), we get the supremum of the Hamiltonian with a given 
gain y 2 denoted by H 1 {x,p) = K 7 (x,p,u*): 

Hj{x,p) =p T f( x) + g(x)g T (x)p + hi T (x)h(x) (8.11) 



8.3.2 The Hamiltonian Formulation in Classical Mechanics 



In classical theoretical mechanics, energy is considered to be in two forms: 
potential energy V, which only depends on the position of the object (V (q)), 
and kinetic energy T, which depends on the velocity as well, i.e. T{q , q). Then 
the following equations of motion can be used: 



d_ 

dt 





i = 1, . . . , n 



(8.12) 



where dim q = n, q is the vector of generalized coordinates, q is the generalized 
velocity, T(q, q) is the total kinetic energy, and Fi are the forces. The forces 
acting on the system can be external forces and internal forces derived from 
a potential V(q): 



dV 
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Lagrangian Formulation. Define the Lagrangian function as 

L 0 (q,q) = T(q,q)-V(q) (8.13) 

where V ( q ) is the potential energy. The Lagrangian function is used as a kind 
of “effect-function” where any motion is considered to take place according to 
the “minimal effect”, i.e. in such a way that the trajectory {q(t), to < t < t±} 
with t 0 , tii <l(to) given is determined by 



rti 

arg min / Lp(q,q)dt, 
</(*) Jto 



Substituting everything into the equations of motion, we arrive at the 
celebrated Euler-Lagrange equations: 



d_ / dLp 
dt \ dqi 



d J^=F e 

dqt 



i = 1, . . . , n 



(8.14) 



Control system equations are obtained from the above equations if the exter- 
nal forces are interpreted as control variables u,, i = 1 , ,n: 



d_ ( dLp 
dt V dqi 



dLp 

dqt 



= Ui, 



i = 1, 



(8.15) 



The usual equations of motion can be derived from Equation (8.15) consid- 
ering that 

T(q,q) = ^ q T M(q)q 

with M{q) being a positive definite matrix: 



M fa) + C (d’ 9) + k(q) = Bu 



(8.16) 



where 



kM = U*" 1 ' B = 



0 



The above equation can be represented in a standard state-space model form 
as: 



d 

dt 



q 



M-\q)(C(q,q) + k(q)) 



0 

M~ 1 (q)B 



(8.17) 



Observe that the state vector of the system contains both the position and 
the velocity of the objects, i.e. 



x = 
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Definition 8.3.1 (Lagrangian for mechanical systems) 

For a mechanical system with n degrees of freedom, in general, one can define 
a Lagrangian L(q, q, u) directly depending on the input u, and the equation of 
motion (8.15) becomes 



d_ ( dL(q, q, u) \ __ dL(q,q,u) 

dt \ 8q t ) d Ql ’ * ’ ' - 

A direct comparison to (8.15) results in the relation: 

m 

L(q, q, u) = L 0 (q, q) + ^ qm 

i= 1 

where m is the number of inputs. 



(8.18) 



(8.19) 



The resulted Lagrangian consists of two parts: the internal Lagrangian 
L 0 {q , q) and the coupling part describing the effect of the external forces. 

A system described by Equation (8.18) is usually called a Lagrangian 
control system in the literature. 

Hamiltonian Formulation. We can now move on to the Hamiltonian for- 
mulation. Define the generalized moments as 



dL(q,q,u) 
Pi = wt 



i = 1, . . . , n 



( 8 . 20 ) 



It can be shown that pi, i = 1 , ... ,n are independent functions if the matrix 
{d 2 L / dqidqj} is nonsingular everywhere. 

Definition 8.3.2 (Hamiltonian for mechanical systems) 

The Hamiltonian function can be defined as the so-called Legendre transform 
of L: 



n 

H{p,q,u) = ^2,Pi(li~ L(q,q,u) (8.21) 

i = 1 



It is simple to deduce that 
dH(p, q, u) 



qi = 
i>i = 



dpi 

dH{p, q, u) 
dqi 



i = 1, . . . , n 
i = 1 , . . . , n 



( 8 . 22 ) 

(8.23) 



The first equation holds by construction and the second one follows by sub- 
stituting Equation (8.20) into Equation (8.18). The second equation is then 
the equation of motion in a Hamiltonian formulation. 

Note that the variables pi, i = 1, . . . , n, being the moments of the system, 
are called co-state variables. Unlike the original state variables qi, i = 1, . . . , n 
being co-ordinates, the co-state variables are extensive quantities which are 
conserved. 

The system described by (8.22)-(8.23) is called a Hamiltonian control 
system in the literature. 
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Hamiltonian Function as the Total Energy. There is another interpre- 
tation of the Hamiltonian function. If L{q , q , u) is defined by Equation (8.19), 
then it follows that 



H(q,p,u) = H 0 (q,p) -^qm (8.24) 

»= l 

where Hq is the Legendre transform of Lq. Observe that the Hamiltonian 
function contains two parts: the internal Hamiltonian H 0 (q,p) and the cou- 
pling part. 

For mechanical systems, L 0 is given as L 0 = T(q,q) — V(q), where 
T(q,q) = ^ q T M(q)q and p= dL/dq 



Therefore 

p=M{q)q (8.25) 

holds, with M (q) being a positive definite matrix. Then it follows that 

H 0 (q,p) = ^p T M~ 1 (q)p+V(q) (8.26) 

that is, the internal energy of the system contains a kinetic and a potential 
energy part, respectively. 

The following simple mechanical example illustrates the above: 



Example 8.3.1 (Hamiltonian model of a spring) 

Harmonic oscillation 



Let us have an ideal spring with spring constant k connected to a 
mass point to. Describe the motion around its steady-state point 
at x = 0. 

The Lagrange function is in the form: 

L = T — V = -mx 2 — -kx 2 
2 2 

Therefore the co-state variable is 

dL 

p = ttv = mx 
ox 
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Then the Hamiltonian is in the form of 

” 2 kx 2 

~Y 



p 

H = T + V = — 
2m 



and the canonical equations of motion are 



dH _ 

dp ) X m’ 



dH . 

— = |p=-tx 



8.4 Affine and Simple Hamiltonian Systems 

The notion of Hamiltonian systems has been introduced already in Section 
8.3. Two special cases of Hamiltonian systems are introduced here for later 
use. 



8.4.1 Affine Hamiltonian Input^mtput Systems 

We remember that a system described by Equations (8.22)-(8.23) is called a 
Hamiltonian system in the literature. In some of the cases, the Hamiltonian 
function is in a special, input-affine form 

m 

H(q,p, u) = H 0 (q,p) -^H^pffij (8.27) 

j= i 

where H 0 is the internal Hamiltonian and Hj(q,p), j = 1, ...,m are the 
interaction or coupling Hamiltonians, q is the state and p is the co-state 
variable. 

Note that the above Hamiltonian is an extension to the one introduced 
in theoretical mechanics in such a way that the original interaction terms 
Qj u j have been extended to Hj(p,q)uj. 

Furthermore, we may associate natural outputs to the system as follows: 

dH 

y j = -g^{q,P,u) = Hj(q,p), j = l„v..,m (8.28) 

Notice that in the original definition of the Hamiltonian control system there 
were no output variables present. The natural outputs are artificially defined 
new output variables to the system, even their number is made equal to the 
number of input variables m. 

With the above definitions, the nonlinear state-space model of an affine 
Hamiltonian input-output system is in the form: 
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q i = 



8H 0 ^dH 

\q,p) - 2 ^ u 



dpi 
dHo 



i= 1 



dpi 



'0i 



i = 1, . . . , n 



dHi 






j = i 






2/j = H j( q ,p), j = l, ■■■,'! 



(8.29) 

(8.30) 

(8.31) 



Note again that these definitions are extensions of the original mechanically 
motivated ones. 



8.4.2 Simple Hamiltonian Systems 

We may further specialize the above definition to obtain the notion of simple 
Hamiltonian systems. 

Definition 8.4.1 (Simple Hamiltonian system) 

A simple Hamiltonian system is an affine Hamiltonian system where the func- 
tions Hq, Hi, . . . , H m are of the following special form: 

H 0 ( q ,p) = ^P T G(q)p + V(q) (8.32) 

with G(q) being a positive definite symmetric nx n matrix for every q, and 

Hj( q ,P) = Hj( q ), j = (8.33) 



With the above requirements for the internal and coupling Hamiltonian, the 
nonlinear state-space model of an affine Hamiltonian input-output system 
specializes to the form: 



q i = -i^~( q iP) = G (q)p, i = 1 , ... ,n 



Pi = 



dpt 

dHo 

dqi 



m n J J 

( q ,p) + Yl 



3 = 1 



dqt 



Vj = H j ( q ), j = 1,. ■ . ,m 



(8.34) 

(8.35) 

(8.36) 



The above simple Hamiltonian systems are special cases of the original, me- 
chanically motivated ones in two main points: 

• H 0 (p,q) 

is in a special form suitable for both mechanical and process systems. 

• Hj(q) 

is again special depending only on the co-state variable. 



The following simple mechanical example, a modified version of the system 
introduced in Example 8.3.1, illustrates the above. 
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Example 8.4.1 (Hamiltonian model of a forced spring) 

Simple Hamiltonian description of a harmonic oscillation with 
external force 



Let us have an ideal spring with spring constant k connected to a 
mass point m and let us have an external force F e acting on the 
mass. Give the simple Hamiltonian description of the system. 

We describe the motion around its steady-state point at go = 0 
and regard the external force as the input 

u=F e 



The Lagrange function is in the form: 

1 9 1 , , 

L = T—V + uq= -mg — 2^9 ~ l_ Uq 

Therefore the co-state variable is 

dL 

p = — = mq 
oq 

Then the Hamiltonian is in the form of 

v 2 ka 2 

H = H 0 ~ H x u = T + V - H lU = — + — - qu (8.37) 

2m 2 

and the canonical equations of motion are 



dH _ 

dp ) ^ to’ 



dH 

dq 



= I p = — kq + u 



(8.38) 



It follows from the state equations (8.38) and from the Hamilto- 
nian (8.37) that the natural output to the system is 



V = Hi(q) = q 



(8.39) 



that is, the spring system with an external force as its input is a 
simple Hamiltonian system. 



If we consider friction in the example above, which acts as a damping factor, 
then we can still obtain a simple Hamiltonian model of the system as is shown 
in the next example. 
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Example 8.4.2 (Hamiltonian model of a damped spring) 

Simple Hamiltonian description of damped harmonic oscillation 
with external force 



Develop the Hamiltonian description of the ideal spring with a 
mass point and with friction as a dissipation external force 
F e = gmg. Use the description of the ideal case in Example 8.3.1. 

The state variable q of this system is the distance from the equi- 
librium point at go = 0. The Lagrangian is in the form: 

L = T — V = ^m<) 2 ~ ^fc<Z 2 + t im 9 c l 



Therefore the co-state variable is 



dL 

p = — = rnq 
oq 



Then the Hamiltonian is in the form: 
n2 kq 2 



H — T + V = 



P 

2m 



pmgq 



(8.40) 



and the canonical equations of motion are 



dH 

dp 




P_ 
m ’ 




p = — kq + pmg 



(8.41) 



8.5 Passivity Theory for Process Systems: a Lagrangian 
Description 

Passivity analysis of a nonlinear system requires us to have a storage func- 
tion. This section is devoted to show how a suitable storage function can be 
developed based on thermodynamical principles. 

The system variables and the general form of state-space models of process 
systems introduced in Section 4.2 is the starting point of the analysis. We 
recall that the state equations originate from conservation balances for the 
canonical set of conserved extensive quantities (mass, component masses and 
energy) in each balance volume. 
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8.5.1 System Variables 



In order to get a compact description, we use a notation for the conserved 
extensive quantities in the balance volume j, assuming that they have been 
arranged into a vector: 

(jyU) — [ ... m ? pU) ] T (8.42) 



Then the vector of the corresponding thermodynamical potentials for the 
j-th region is defined as 



p T U) 



dSW 



(8.43) 



and is in the form 



pti) 



TO') 



TO) TO) 



(8.44) 



where ji? is the chemical potential for the component k and TO) is the 
temperature in region j. 



Gibbs-Duhem Relationship. The above entries of pO) are the conse- 
quence of the Gibbs-Duhem relationship, which is valid under the standard 
assumption of local thermodynamical equilibrium [27] applied everywhere in 
each balance volume j. The Gibbs-Duhem relationship for open systems out 
of equilibrium is of the form 

S U) = pT{j) 0(i) + b) V (o) (8.45) 

where p is the pressure. From homogenity of the entropy as a function of 
the other extensive variables Equation (8.45) can be written in 

differential form as follows: 

^ = (i) W> dE«) + (|) 0) dV^ - £ (f ) W) dm? (8.46) 

' ' fe = i 

where the operator d stands for total derivative. Note that the second term 
is equal to zero, because dV^ = 0 caused by the “general modeling assump- 
tions” in Section 4.1.1. 




186 8. Passivity and the Hamiltonian View 



The Reference Point. The notion of centered variables 

with ip* being the reference point of the variable ip introduced in Section 4.2.2, 
plays an important role in the following. It is important to note that the refer- 
ence point for the conserved extensive quantities should be a thermodynamical 
equilibrium point in the general case. This implies that the reference point for 
the input variables should then be chosen in such a way that the right-hand 
side of the general conservation balances (4-3) gives zero in their reference 
point. 

There are a number of consequences of the requirement above on the 
selection of the reference points: 

1. If there is no source term in the general conservation balances then the 
requirement specializes to 

u* = 0 

2. If we have no transfer term then we can select u* arbitrarily. Then it 
is reasonable to choose q* such that it is equal to its setpoint value for 
control and then choose u* to satisfy the requirement. 

3. In the general case we find a thermodynamical equilibrium point close to 
the reference points and then choose u* from it. 



Extensive-intensive Relationship. It is important to note that there is 
a simple linear relationship between conserved extensive quantities and their 
potentials in the form 

P 0) = QWflf) (8.47) 

where Q^ 1 is a negative definite square matrix for which the following rela- 
tionship holds: 



Q 



U) 

n 



d 2 S W 

dcj)^ d(j>^ 



(8.48) 



The above relationship is a consequence of the concave nature of the system 
entropy of the j - th region and of the fact that the system entropy is a 
first-order homogeneous function of the conserved extensive quantities. 



8.5.2 Thermodynamical Storage Function 

The storage function proposed in [29] originates from the overall system en- 
tropy of the following general form: 
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C ( K+l \ C 

V = E ~^ U) + E = E (P T {4>* U) )4> (j) ~ S U) ) (8.49) 

j= i \ fc= l / 1-1 



where is the entropy and P T ^'> is the vector of thermodynamical poten- 
tials for the conserved extensive quantities <j>^ in balance volume j. 

It can be shown that the above function is convex and positive semi- 
definite, taking its minimum at the reference equilibrium (steady-state) point. 

We can transform V to a more suitable form, taking into account the 
infinite series expansion of the entropy around its equilibrium value S*^: 

S U) = s*U) + p r (^*«))0 w) + + 0{4> m ) (8.50) 

with Qti) being a negative definite symmetric matrix (the Hessian matrix of 
the entropy function) 



Q 



U) 

u 



d 2 S 0) 
d^dcj^p 



(8.51) 



to get 



v = E - v (j) (P U) )) 

j = i 



(8.52) 



where V"(.) j s a nonlinear function. 

It is important to observe that we can get the extensive-intensive rela- 
tionship in Equation (8.47) from the Taylor series expansion of the defining 
relationship of the thermodynamical potentials P in Equation (8.43) around 
the equilibrium (steady-state) point with the same matrix as in Equation 
(8.51): 



pU)^U)) = pW)(^*0')) 



dpU) 






(i) _ + 0{(j) U)2 ) 



taking into account only the first-order (linear) 
that 



dp(j) 

d<p W) 



Q u) 



terms. For this, we observe 



is the Hessian matrix of the entropy function, the same as defined in Equation 
(8.51). 



8.5.3 Transfer Terms 

The difference between the thermodynamical potentials as driving force vari- 
ables induces transfer flows between regions in mutual contact. It is assumed 
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that the transfer term of any of the regions can be decomposed into pair-wise 
transfers, which are additive: 

C 

a U) = V- j.U/) 

y<fi,transfer / j q,transfer 
1=1 



Onsager Relationship. The celebrated Onsager relationship of the irre- 

(j £) 

versible thermodynamics connects the transfer fluxes ’transfer with the 
potentials in the form 



a W) 

fi,transfer 



= L u ’ e) (P u) - pW) 



(8.53) 



where the matrix j s positive definite and symmetric [27], [42]. 



It is important to note that usually the difference of the engineering driv- 
ing forces (< P d) — is considered on the right-hand side of the transfer 
term (8.53). It can be shown, however, that the positive definiteness and 
symmetricity of the coefficient matrix cannot be guaranteed in this case, 
therefore we shall always use the thermodynamically correct expression in 
Equation (8.53) instead. The following table shows the relation between con- 
served extensive, engineering and thermodynamical driving force variables. 



Table 8.1. Relation between thermodynamical variables 



Case 


Conserved 

extensive 


Engineering 
driving force 


Thermodynamical 
driving force 


general 

(p = Q4>) 




$ 


P 


energy 
(E = cpmT ) 


energy 

E 


temperature 

T 


rec. temperature 
i 

T 


comp, mass 
fpk = RT In Ck) 


comp, mass 
m k 


concentration 

Ck 


rel. chem. potential 

Mfc 

T 



If we further choose the thermodynamical equilibrium point as a reference 
value for the thermodynamical potentials where 

P *U) = P *W ( 8 .54) 



then we can develop the normalized version of the Onsager relation in the 
form of 



a U/) 

^<f),transfe 




L (i/) > o 



= (8.55) 
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8.5.4 Decomposition of the Time Derivative of the Storage 
Function 



The time derivative of the storage function above in Equation (8.49) is in the 
form 



,,, C K + 1 ,-tO') c Mj) 

dV _ _ ST' ST' pCi) dpi _ _ ST' -p T ti) dtp 

dt ~ ^ ^ 1 dt ~ ^ dt 

j=i *=i j=i 



(8.56) 



Observe that the equation above contains the left-hand side of the normalized 
general conservation balance equation (4.3). 

With the above observation, the time derivative of the storage function 
can be decomposed in exactly the same way as for the right-hand side of the 
conservation balances 



dV 

dt 



■y transfer _j_ yiconv _|_ oconv _j_ -y source 



(8.57) 



where the terms have the following special form: 

1. The convective and transfer terms of the balance equation (8.57) above 
is in the form of 



yoconv _|_ transfer 



x t R X xx 



(8.58) 



with R xx being a negative definite matrix in the case of Kirchoff or 
passive convection between the balance volumes. 

2. The inflow term is in the form 

C 

Vr nv = -J2 v {j) a i J ) P T{j) $ ( £ (8.59) 

i~ i 

(j) . 

where is the ratio of the system inflow to the overall input flow rate 
of the j- th region. 



8.5.5 Passivity Analysis 



The passivity analysis is performed by using the decomposition of the time 
derivative of the storage function in Equation (8.57), assuming that the con- 
served extensive quantities at the inlet are chosen as input variables: 




If every term on its right-hand side is negative definite then the system itself 
is passive, that is, asymptotically stable. 

The special form of the convective and transfer terms in Equation (8.58) 
shows that the transfer and convective mechanisms ( assuming Kirchhoff or 
passive convection) are passive in every process system. 
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In the case of open-loop systems , we assume that the inlet inflow terms in 
any of the regions are kept constant, that is, 




This implies that the inlet inflow term V i ? con ' ! ' is identically zero, that is, it 
gives no addition to the time derivative and is therefore “neutral” from the 
viewpoint of the passivity of the system. 

Finally, the source term \>^ ource is indefinite (neither positive nor negative 
definite) in the general case. This means that: 

1. An open-loop process system with no source and only Kirchhoff or passive 
convection is always passive, that is, asymptotically stable [29] . 

2. A suitable nonlinear feedback can be designed to make the sum of the 
terms \)* conv and V®°“ rce always negative definite (see later in Chapter 
12 ). 



8.6 The Hamiltonian View on Process Systems 

In order to find the Hamiltonian function of a process system, we use the 
mechanical analog described in Section 8.3 and extend it to process systems 
using the storage function (8.49) [30]. 

First, we notice that the Hamiltonian for mechanical systems is the overall 
energy of the system and therefore it can serve as a storage function for their 
passivity analysis. In process systems the direction of the “movement” of the 
system, that is, its time evolution in the state-space is driven by entropy: 
closed systems are in equilibrium when their overall entropy is maximum. 



8.6.1 State, Co-state and Input Variables 

Following the mechanical analog, the following state and co-state variables 
are identified for the Hamiltonian description of process systems: 

-T(l) -jT(C) T , 0 

P=Yt> ■ ■ ■ <t> ] (8-60) 

q = [P ni) . . . P T(C) ] t (8.61) 

This means that the generalized moments are the normalized conserved ex- 
tensive variables and the generalized co-ordinates are the normalized ther- 
modynamical driving forces. 
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Static Relationship between States and Co-states. In addition to the 
state-space model equations, there is a linear static (i.e. time-invariant) re- 
lationship originating from Equation (8.48) between the state and co-state 
variables of a process system in the form 



q = Qp 



(8.62) 



where Q is a negative definite symmetric block-diagonal matrix of the form 



0 ... 0 
0 QW 0 . . . 0 

0 0 ... 



(8.63) 



The above equations are the consequence of the definitions of the state and 
co-state variables in Equations (8.60) and (8.61), and of the concavity of the 
entropy function near an equilibrium (steady-state) point. 

Onsager Relationship. There is another relationship between the state 
and co-state variables of a process system which can be derived from the form 
of the Onsager relationship in Equation (8.55), which gives an expression for 
the transfer rate of conserved extensive quantities as a function of the related 
thermodynamical potentials as driving forces: 

Ptransfer = ' t P<!>,t r ansfer = £ Qi > 0 , — C, (8.64) 

where the matrix C is positive definite and symmetric in the following form: 

i=i e=i 

Observe that the matrix C in (8.64) is the same as the transfer matrix 
A transfer hr the decomposed state equation (4.15). 



8.6.2 Input Variables for the Hamiltonian System Model 

In order to have a Hamiltonian description of process systems, we have to 
assume that only the mass flow rates form the set of input variables, with 
the inlet engineering driving force variables being constant. Then the set of 
normalized input variables is the same as in Equation (4.12): 



u= [(u W ), j = 1,...,C] T 
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8.6.3 The Hamiltonian Function 



Following the mechanical analog, the Hamiltonian function of process systems 
should describe the direction of changes taking place in an open-loop system. 
The mechanical analog and the general defining properties (8.32)-(8.36) of 
simple Hamiltonian systems will be used for the construction of the simple 
Hamiltonian model of process systems by using the Onsager relationship 
(8.64) and the conservation balances (4.3) together with the relationships 
between the state and co-state variables (8.62). 

Construction of the Hamiltonian. The Hamiltonian function is then con- 
structed in two sequential steps as follows: 

1. The kinetic term 

The kinetic term is constructed from the Onsager relationship (8.64) by 
transforming it into the form in Equation (8.34) by using the relationship 
between the state and co-state variables in Equation (8.62) to obtain 

q = ( QCQ ) p = Gp (8.65) 

where Q is a positive semi-definite symmetric matrix that does not depend 
on q. Symmetricity follows from the identity 

(' QCQ) t = QCQ with Q T = Q, C T = C 



and positive semi-definiteness is a simple consequence of the positive 
semi-definiteness of C 

x T (QCQ) x = ( Qx) t C (Qx) = y T Cy > 0 Vi 

The kinetic term T(p) in the Hamiltonian function will be constructed 
to satisfy Equation (8.34), i.e. 

T(p ) = ^p T Gp (8.66) 

2. The potential term and the coupling Hamiltonians 

The potential term and the coupling Hamiltonians are derived by match- 
ing the terms in the special form of the defining Hamiltonian property 
(8.35), taking into account that now Q does not depend on q 



dH 0 

Pi = 

oqi 






j=i 



dq-i. 



dV(q) 

dqi 



+E 



3=1 



d Hi 
dqi 



(q) uj 



(8.67) 



with the terms in the decomposed general conservation balances (4.15) 
with the flow rates as input variables: 
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p = (£q + Q<fi(q)) + ^ ( N iQ 1( l u 3 + B i,convUj) (8.68) 

3 = 1 
m 

= f(q) + ^29j(q)uj 
i=i 

where Bj tConv is the j-th column of the input convection matrix B conv . 
From this correspondence the potential energy term V ( q ) and the cou- 
pling Hamiltonians Hj(q) should satisfy 



fM 



dV{q ) 

dqt 



9ij(q) 




(8.69) 



With the above ingredients the Hamiltonian function of a process systems is 
written in the form 



H ( p , q, u) = T(p) + V (q) - ^ Hj (. q ) uj 

i= i 



(8.70) 



satisfying all the required properties in Equations (8.34)-(8.36). 

We may further specialize the form of the Hamiltonian function above 
by using the decomposition of the state function f{q) in Equation (8.68) 
according to the mechanisms (transfer and source) to get a decomposition of 
the potential term V(q) to satisfy (8.69): 

V {q) = Vtransfer{q ) d~ ^ / q( ( ?) 

VtransfeM = -\q T Cq, ^^- = -Q^q) (8.71) 

Substituting the above decomposed potential term to the Hamiltonian func- 
tion (8.70) above, we obtain 



H(p,q,u ) = V Q (q) - ^ Hj{q ) u 0 
3 = i 



(8.72) 



It can be seen that there is no kinetic term in the equation above because 



— Vtransfer(q) 

but the internal Hamiltonian does only contain the potential term originating 
from the sources. 

The above constructive derivation gives rise to the following theorem, which 
summarizes the main result: 



Theorem 8.6.1. Given a process system with the input variables (f.12) as 
the flow rates, the state and co-state variables (8.60) and (8.61) enables us to 
construct a simple Hamiltonian system model with the Hamiltonian function 
(8.72) and with, the underlying relationships in Equations (8.65), (8.68) and 
(8.62), (8.69). 
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Remarks. There are important remarks to the above as follows: 

• The supply rate 

As has been mentioned before, the internal Hamiltonian function is a stor- 
age function of the system with respect to the supply rate J2jLi Hj{q) Uj. 
Recall that the so-called natural output variables have been defined to be 
equal to the coupling Hamiltonians, that is, ijj = Hj(q). Therefore the 
supply rate of the system can be written in the form of 

T 

a = y u 

• The internal Hamiltonian 

It is important to note that the internal Hamiltonian above is a storage 
function for process systems which gives the total entropy power (entropy 
produced in unit time). This can be checked by computing the units in 
the Hamiltonian function. Therefore the storage function derived from the 
simple Hamiltonian description is entirely different from the entropy-based 
storage function in Equation (8.f9). This is explained by the known fact 
that the storage function of a nonlinear system is not unique. 

• The time derivative of the Hamiltonian storage function 

For stability analysis the time derivative of the storage function is impor- 
tant, which is in a special form in this case: 

dH 0 (q,p) _ / dH 0 dpi dHp dq, \ 

dt \ dpi dt dqi dt ) 

= V (— - dHpdHp\ = 

“ V dPi d< H dqi dpt ) 

where the defining Equations (8.34) and (8.35) have been used for the 
derivation with u = 0. 



8.7 Comparing the Hamiltonian and Lagrangian 
Description for Process Systems 

The process systems’ engineering conditions that enable us to construct a 
Lagrangian or a Hamiltonian description are compared in Table 8.2 below. 
It is shown that process systems with constant mass hold-ups in each bal- 
ance volume, constant physico-chemical properties and no source enable both 
conditions if the input variables are suitably chosen. 



8.8 Simple Process Examples 

Simple process examples serve to illustrate the notions and tools described 
in this chapter. The heat exchanger cell, the free mass convection network 
and a simple unstable CSTR model developed in Chapter 4 is used. 
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Table 8.2. Comparison of the Hamiltonian and Lagrangian system models 

Lagrangian Hamiltonian 



Input inlet intensive mass flow rates 

quantities 

Internal mechanism transfer, (source) transfer, (source) 
convection 

Special condition Hamiltonian source 



8.8.1 Storage Function of the Heat Exchanger Cell 



The storage function of the nonlinear heat exchanger cell model developed in 
Section 4.4 is constructed from its state-space model by identifying its state 
and input variables. 

System Variables. The vector of conserved extensive quantities of the non- 
linear state-space model Equations (4.47)-(4.48) is composed of the vector 
of internal energies E ^ and E c for the two balance volumes in question: 

4>=[E h ,E c ] T , n = 2 (8.73) 

that is, the regions j = h,c of the hot and cold sides respectively. 

Note that with our modeling assumptions, the following relation holds 
between the volume-specific energy and the temperature of a balance volume: 



Ej — cpjPjVjTj + Eo (8.74) 

with E 0 being an arbitrary reference. 

Centered Variables and their Relationships. Let us consider a reference 
state E * h , E* defined as a stationary (equilibrium) state with the correspond- 
ing driving forces tAt, Jy and let us denote the difference from the reference 

1 h 1 c 

state by overlining, i.e. 

E j =E j -E* . 

The special form of the Onsager relation between the volume-specific energy 
and the reciprocal temperatures as driving forces can be derived from the 
relation in Equation (8.74) by expanding into a Taylor series to obtain 



i = M-Ej , M' = - 



Tj 



°PjPjVj (Tj ) 



with Mj < 0 being a constant in this case. 



(8.75) 
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Storage Function. The storage function V(<p^) for the j-th region of the 
simple heat exchanger can be defined as follows: 



V(£,) = 



—Sj H — Ej 

J rji* J 



(8.76) 



where Sj is the difference between the entropy of the balance volume char- 
acterized by the thermodynamical state Ej and the reference entropy for 
j = h, c. 

With the relation between the potential and conserved extensive variables 
in Equation (8.75), the storage function takes the form: 



V(Ej) 



-Sj + — 

1 T* M Tj 
\ o j ■> / 



(8.77) 



The storage function of the overall heat exchanger composed of the two 
(j = h, c ) regions is simply the sum of the individual storage functions (8.77) 
above: 

v(^) = £ V(Ej) (8.78) 

j=h,c 

depending on the non-normalized vector cf> of conserved extensive quantities 
in Equation (8.73) of the overall system. 

8.8.2 Hamiltonian Description of the Heat Exchanger Cell 

The Hamiltonian system model of the heat exchanger cell is again developed 
from its state-space model described in Section 4.4 by identifying its state, 
co-state and input variables. 

The continuous time state equations of the heat exchanger cell are derived 
from the following energy conservation balances: 

= v c (t)cp c (T c i(t) - T c (t)) + UA(T h (t ) - T c (t)) (8.79) 

at 

C ^- L = v h (t)c Ph (T hi (t) - T h {t)) + UA{T c {t) - T h (t)) (8.80) 

where Tji and X) are the inlet and outlet temperature and Vj is the mass 
flow rate of the two sides ( j = c, h) respectively. Note that we have now two 
regions, that is, C = 2. Observe that the model equations above contain an 
input and output convection and a transfer term expressed in engineering 
driving forces, but there is no source term. 
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System Variables. The vector of conserved extensive quantities consists of 
the internal energies for the two regions: 

cj> = [E h ,E c ] T , n = 2 

Let us choose the volumetric flow rates v c and v h as input variables. 

Extensive— intensive Relationship. Let us choose a reference thermody- 
namical equilibrium state for the heat exchanger cell such that 

= T* = T* (8.81) 

The energy-temperature relations are known from elementary thermodynam- 
ics: 



Ej = cpjirijTj + Eq, Ej = Ej — E* (8.82) 

where rrij is the constant overall mass of region j = h 1 c. From Equations 
(8.82), we obtain by expanding into the Taylor series that 

Tj = 

1 3 



=Q U) Ej , Q«) 

1 j 



1 

cpjm.j(T *) 2 



with Q( J ") < 0 being a constant in this case. Therefore 



Q 



cph,m h (T *) 2 

0 



0 

1 

c Pc m c (T *) 2 



Centered System Variables. With the reference equilibrium state (8.81), 
we can easily define the centered state and thermodynamical potential (driv- 
ing force) variables as 



4 = 

V = [ E h , 



1 

T c 

E c 



From the conservation balance equations (i.e. Equations (8.79)-(8.80)), it 
follows that now the reference point for the input variables is the zero vector, 
therefore 

u=[v h , v c } T 
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Decomposed State Equation in Input-affine Form. With the above 
defined centered system variables the conservation balance equations, which 
are Equations (8.79)-(8.80), can be written in the following canonical form: 



dp 

dt 



2 

At.rans f er q + B\ C U + 'y ( NiUi 
i = 1 



with 



Atransfe 



( T *) 2 



UA - UA 
-UA UA ’ 



cphThi 0 
0 cp c T ci 



(8.83) 



(8.84) 



JVi(Tfc) 



—cphTh 

0 



N 2 (T c ) 



0 

—cp c T c 



where Atransfer and B\ c are constant matrices and N% and N 2 are linear 
functions of the centered engineering driving force variables. Observe that 
now the transfer function matrix L is just a constant UA (a 1 x 1 matrix) 
and 






1 -1 
-1 1 



Hamiltonian System Model. Let us now develop the Hamiltonian de- 
scription of the nonlinear heat exchanger cell model. 

The internal Hamiltonian of the heat exchanger cell system is easily con- 
structed from the special form of the Hamiltonian developed for process sys- 
tems in Equation (8.72), taking into account that there is no source term in 
the conservation balance equations, i.e. Vq{<i) = 0 



H 0 (q,p) = 0 



(8.85) 



Now we need to identify the coupling Hamiltonians H\{q ) and H 2 {q) from 
the co-state equation (8.83) for the input variables 

u = [v h , v c } T 



The coupling Hamiltonians can be reconstructed from the vector functions 
gi(q) and g 2 (q) respectively, which are the gradient vectors of the correspond- 
ing coupling Hamiltonians: 



dH i 
dq 



SiO?), 



dH 2 
dq 



92{q) 



Observe that the gradients are naturally given in terms of the engineering 
driving force variables d> but we need to transform them into the form de- 
pending on the state variables q. In the heat exchanger cell case, we have 
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-cphTh + cphTh, 


i 




cph ( T *) 2 qi + cphT hi 


0 






0 


0 






0 


cpcTc T c Pc T ci 






Cp c ( T*)~ q 2 + c Pc T ci _ 



gi(T h ) = 

92(T h ) = 

By partial integration, we obtain 



1 



Hi (q) = 2 Cph 0^*) 2 9i + c PhThiqi 



H 2 (q) = 2 Cp ° ( T *) 9-2 + c Pc T ci q 2 



9i(q ) 
32(g) 



(8.86) 

(8.87) 



From the passivity analysis we know that the system is inherently passive 
but it has a pole at the stability boundary because there is no source term 
and Vq(( 7 ) = 0. Therefore we can perform stabilization by a derivative feed- 
back and loop-shaping by a static feedback using PD controllers (see later in 
Subsection 12.1.3). 



8.8.3 Hamiltonian Description of the Free Mass Convection 
Network 

The engineering dynamic model of the free mass convection network (see 
in Section 4.2.4) originates from the conservation balance equations of the 
overall mass given in Equation (4.22). 

The linear state-space model (4.22) is transformed into its Hamiltonian 
canonical form by considering the following set of state, co-state and input 
variables: 

q = [ pgh (1) ,..., pgh iL) } T 

} T 

T 

— 0 ) 

where h is the centered level of the liquid in balance volume j where con- 
stant cross-section A and liquid density p is assumed in each balance volume 
and the gravitation constant is denoted by g. There are simple static rela- 
tionships between the level and volume of the j-th balance volume 

V (A = Ah u) . 

Then the balance equations written for the co-state variables become 

-j: = C conv ICp Vin = C conv ICQ x q Vin (8.88) 

at p p 

Now the matrix Q is in the form of 



r tt(1) 

P=[V ,. 

r (1) 

u = [ V IN > • ‘ 



F (c) 

V (C) ] 
U IN J 
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i 


0 .. 


..o' 




0 


P9 


. 0 


Q = 


A ’ ' 




0 


o .. 


1 



Finally, the internal Hamiltonian of the passive mass convection system is 
H 0 (q,p) = T(p) + V(q) = q T {C conv !CQ- l )q (8.89) 

which only has a kinetic term. 



8.8.4 Hamiltonian Description of a Simple Unstable CSTR 

Let us have an isotherm CSTR with fixed mass hold-up m and constant 
physico-chemical properties where a second-order 

2 A + S -» T + 3A 



autocatalytic reaction takes place. The engineering model of the reactor is 
developed in Section 4.5.1 from the conservation balance for the component 
mass of component A. 

Assume that the inlet concentration of component A ( CAin ) is constant 
and the inlet mass flow rate v is used as an input variable. We develop the 
Hamiltonian description of the system around its steady-state point deter- 
mined as the setpoint for passivation and loop-shaping. This description is 
then used later in Section 12.4 for a nonlinear proportional feedback controller 
to stabilize the system. 

Conservation Balance Equation and System Variables. The state 
equation is a single component mass conservation balance equation for com- 
ponent A in the form 



drriA 

dt 



d{m ■ ca) 
dt 



= VCAin - VCA + k- m- c\ 



(8.90) 



where itia is the component mass, m is the constant overall mass and k is 
the reaction rate constant. Note that we only have a single balance volume, 
therefore C = 1. 

The given steady-state concentration c* A with a nominal mass flow rate 
v* satisfies 

0 = v*(c A in - C* A ) + k-m ( C* A f 
From this, we can determine v* as 



k ■ m (c A ) 2 



v' 



CAin 
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which should be non-negative, therefore CAin < c A should hold. The given 
steady-state concentration c* A also determines the nominal value of the con- 
served extensive quantity toa, the component mass in this case being: 

m* A = m - c a 

The engineering driving force variable to the component mass itia is the 
concentration ca and the thermodynamical potential (driving force) variable 
is 

P = —R'ji A = —R"\yica = —Rca 

with R being a constant under isotherm conditions and assuming ideal mix- 
tures. 

Hamiltonian System Model. It follows from the above that the centered 
system variables for the Hamiltonian description of the simple unstable CSTR 
are as follows: 

p = Tua = tua — fn*A, q=—(cA — c* A ), u = v — v* (8.91) 

Observe that the constant R has been omitted from the definition of the co- 
state variable q as compared to the thermodynamical driving force q above. 
From the variable definitions above we see that the matrix Q specializes to 




From the conservation balance equation in Equation (8.90), it is seen that 
there is only a single balance volume present in the system and there is no 
transfer term. Therefore the transfer coefficient matrix C = 0. This implies 
that now the reference point for the state and co-state variables can be chosen 
arbitrarily. However, the source term Q $ is now present as a second-order 
term originating from the autocatalytic second-order reaction. 

If we substitute the centered variables in Equation (8.91) to the conser- 
vation balance equation (8.90), the following normalized state equation is 
obtained: 

-j- = (k ■ m ■ q 2 — (2k • m • c A + v*) ■ q) + (cAin + q)u (8.92) 

at 

From the equation above we can identify the elements of the Hamiltonian 
description to be 

= -(k-m-q 2 - (2 k ■m-c* A + v*) ■ q) , = ( c A in + q) 

By partial integration we obtain 

VQ(q) = ~^k-m-q 3 +^ (v* + 2k ■ m ■ c* A ) ■ q 2 

Hi (q) = ^q 2 + c A i n q 



(8.93) 

(8.94) 
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Passivity Analysis of the Unstable CSTR. The passivity analysis is 
performed by using the internal Hamiltonian of the system 

H 0 {q,p) = V Q {q) = ~^k ■ m ■ q 3 + ^ (v* + 2k ■ m ■ c* A ) ■ q 2 

We can see that the above function is of no definite sign because of the 
presence of the second- and third-order terms of different constant coefficients 
and different signs. This means that the system fails to be passive in the 
general case. 



8.9 Further Reading 

The idea of using physical knowledge to construct storage functions for pas- 
sivity analysis is not new: it is worth reading the early papers and books, 
such as [80] and [19]. 

The traditional and still main application area of Lagrangian and Hamil- 
tonian system models and their physics-based control is in meclratronics 
(robots): see [65] for a simple introductory paper. A good early survey of 
Hamiltonian system models in meclratronics is found in [52]. 

Process Systems. There is a wide and growing literature in the field of 
making connections between thermodynamics, variational calculus and the 
theory of Hamiltonian systems. Ydstie [83] offers a recent survey of related 
papers. The papers in this area can be classified according to the system 
models they use for dynamic analysis and controller design. 

• Lagrangian process system models 

The idea of investigating dissipation and passivity of process systems based 
on thermodynamical principles was introduced in the 1990’s [55], [84], [23], 
where its implications of controller design have also been explored. The ap- 
proach is applied to networks of process systems, i.e. to composite process 
systems with several balance volumes in [28] . 

• Hamiltonian process system models 

The principles of constructing a Hamiltonian system model can be found 
in [30]. 



8.10 Summary 

Lagrangian and Hamiltonian system models are special, extended model 
forms for input-affine nonlinear systems. Besides the usual elements of non- 
linear input-affine state-space models, they have an additional structure in 
their set of system variables. Moreover, they are equipped with an additional 
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storage function which enables us to carry out passivity analysis in a straight- 
forward way. 

It is shown that process systems with constant mass hold-ups in each 
balance volume, constant physico-chemical properties and no source enable 
both Lagrangian and Hamiltonian system models if the input variables are 
suitably chosen. The selection of the input variables changes the effect of 
convection from an internal mechanism in the Lagrangian case to a coupling 
one in the Hamiltonian case. Besides the special input selection, an additional 
source condition should hold for Hamiltonian process systems. 



8.11 Questions and Application Exercises 

Exercise 8.11.1. What is the relationship between passivity and asymp- 
totic stability of nonlinear systems? Comment also on the relationship be- 
tween Lyapunov functions and storage functions. 

Exercise 8.11.2. What are the ingredients (elements) of a simple Hamil- 
tonian system model? Comment on the relationship between a usual input- 
affine state-space model and a Hamiltonian system model. What are the 
common and additional elements in a Hamiltonian model? 

Exercise 8.11.3. Give the elements of a Lagrangian system model of a pro- 
cess system. Comment on the relationship between a usual input-affine state- 
space model and a Lagrangian process system model. What is the engineering 
meaning of the additional model element in a Lagrangian systems model? 

Exercise 8.11.4. What are the elements of a Hamiltonian system model of a 
process system? Give the relationship between a usual input-affine state-space 
model and a Hamiltonian process system model. What is the engineering 
meaning of the additional model elements in a Hamiltonian systems model 
of a process system? 

Exercise 8.11.5. Compare the elements of the Lagrangian and Hamiltonian 
system models in the example of the heat exchanger cell which is described 
in Section 8.8.1 with a Lagrangian and in Section 8.8.2 with a Hamiltonian 
system model. 

Exercise 8.11.6. Construct a Lagrangian system model of the simple unsta- 
ble CSTR model developed in Subsection 4.5.1 using the inlet concentration 
CAin of component A as the input variable. Compare the resulting model with 
the Hamiltonian one developed in Subsection 8.8.4. 

Exercise 8.11.7. Consider a simple unstable CSTR model developed in 
Subsection 4.5.1 but with the reaction rate expression 

r = k ■ in ■ c\ 
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Construct a Hamiltonian system model of the CSTR following the derivation 
in Subsection 8.8.4. 

Exercise 8.11.8. Consider the input-affine nonlinear state-space model of 
a simple continuous fermenter that is developed in Section 4.5.3 and given 
in Equations (4.78)-(4.79). Construct a simple Hamiltonian model for this 
system. 
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This chapter summarizes the basic notions and techniques for the control of 
nonlinear systems. The material is mainly a revised summary of the control 
of LTI systems ([39], [9] ) with a view to extending them for the nonlinear 
case. 

The material in the chapter is broken down into the following sections: 

• The notion of control and feedback 

We start with the notion of control and the tasks we need to perform for 
control. The general notion of feedback together with that of output and 
state feedback is also given here, and the notion of full state feedback and 
linear and nonlinear static feedback is introduced. 

• Pole-placement controller for LTI systems 

One of the basic types of full state feedback controllers is the pole- 
placement controller, which is described here for LTI systems. 

• LQR for LTI systems 

The linear quadratic regulator (LQR) is a widely applied and theoreti- 
cally important controller. It is introduced here for LTI systems and its 
properties are shown. 

• Hamiltonian view on controlled systems 

Here we connect the optimization-type formulation of controller design 
with a Hamiltonian system description in order to facilitate the under- 
standing and analysis of the properties of controlled systems. 

• Case study: linear control of a continuous fermentation process 

In the example of a simple continuous fermentation process, this section 
shows the common way of controlling nonlinear process systems using linear 
controllers and indicates possible problems associated with this approach. 



9.1 Control and Feedback 

Until now, we investigated process systems as they are: we have learned about 
various mathematical descriptions of systems ( representation of systems) and 
analyzed dynamical properties like stability, controllability and observability 
{system analysis). We did this with a purpose: the main aim of system rep- 
resentation and analysis is to influence the behavior of systems (that is, to 
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control them) and to make decisions based on their expected behavior (to 
perform a diagnosis on them) . 



9.1.1 Control and Optimization 

When we manipulate the input signals of a system in order to achieve some 
goal concerning its behavior then we “control” it. From this description, it 
follows that we should have a goal or control aim in mind when approaching 
a system with the intention of controlling it. 

A suitable or the best input signal can then be selected by a simple “gen- 
erate and test” method: we try an input signal, evaluate it from the viewpoint 
of the goal and then try another one, possibly by improving the previous one. 
The way we figure out a suitable or the best input signal to achieve our goal 
is usually performed by optimization. 

Aim. Control methods can be classified according to the control aim, or in 
other words, the goal function. The most common goals are as follows: 

1. We want to keep a prescribed value of the output signals as close as 
possible against disturbances which cause them to change. This control 
task is called regulation. Linear Quadratic Regulators (LQRs) perform 
control according to this type of goal function. 

2. We may want to move the state variables of the system from one pre- 
scribed initial state to a given final state as quickly as possible. This con- 
trol task is called time-optimal control and it is quite common in process 
systems. 

3. We might try to stabilize unstable systems or improve their dynamic be- 
havior. This is done by stabilizing control, for example by pole-placement 
control. 

Process Models as Constraints for Control. The control goals are for- 
mulated in terms of a desired output behavior ( e.g . constant output) or a 
system property (like stability), which should be achieved by manipulating 
the outputs not directly but indirectly via the input signals and through the 
dynamics of the system. The dynamic nature of the system, which is encoded 
in the system model, gives a natural constraint on what we can achieve. This 
fact is reflected in the control aim sentences above, i.e. “as close as possible”, 
“as quick as possible”, and so on. 



9.1.2 Feedback 

The Role of Feedback. Feedback is a central notion in control theory. Most 
of the controllers, but not all of them, apply either state or output feedback 
to compute the control action, that is, the input value which is needed to 
achieve the control aim. 
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Consider the general input-output relation y = S [it] introduced in Chap- 
ter 2. The most common control objective is to select the input u such that 
the system output follows a given reference r, i. e. 

r = S[u] (9.1) 

This can be solved theoretically if we manage to express u from (9.1). How- 
ever, generally, we cannot solve this problem. In many cases, it is possible 
to approximate the solution, but this approach usually does not work well 
in practice because there are usually unknown disturbances that affect the 
process and the plant dynamics is rarely known completely, i.e. there are 
model uncertainties. 

As we will see soon, feedback is able to change some of the key dynamic 
properties of the system completely, while other properties might be invariant 
to feedback. One reason for applying feedback is that a well-clrosen feedback 
is able to reduce the effect of uncertainty. That is why controllers designed 
for rough linear models may work reasonably well with the original nonlinear 
system. On the other hand, feedback is the only tool that stabilizes unstable 
systems. 

9.1.3 Different Kinds of Feedback 

In the next few paragraphs, we define the different kinds of feedback that are 
most often applied to a nonlinear system of the form (3.19), i.e. 

x(t) = f«t)) + Y:Zi9Mt))u i (t) 

y(t ) = h{x(t)) 

Static feedbacks make instant relations between the output (or state) and in- 
put variables, while dynamic feedbacks bring additional dynamics (i.e. new 
state variables) into the control loop. Output feedbacks use only output in- 
formation to generate input, while state feedbacks process the whole state 
vector. 

Output feedback has been applied from the very beginning of the exis- 
tence of controllers. The commonly used PID controller can also be seen as 
a controller for single-input-single-output systems based on dynamic output 
feedback with constant parameters. It is important to know, however, that 
output feedback cannot stabilize even a linear time-invariant system in every 
case, that is why state feedback is used in advanced control schemes. 

As one would naturally expect, generally control goals are easier to achieve 
when applying state feedback, since the controller can process more informa- 
tion than in the output feedback case. Note that a state feedback is a special 
case of output feedback, with the output y being the whole state vector x. 

Static feedbacks are classified further, according to whether a new refer- 
ence input is introduced into the closed- loop system or not. The various 
forms of static feedbacks are defined formally below. 
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Definition 9.1.1 (Static state feedback) 

A static state feedback for the system (3.19) is defined as 

u = a(x) (9.2) 

where a : X i— > ]R m is a smooth function. 

Definition 9.1.2 (Static state feedback with new input) 

A static state feedback with new input v is of the form 

u = a(x) + (3(x)v (9.3) 

where a : X i— > R m and (3 : X i— > R' mxm are smooth mappings. Furthermore, 
P(x) is invertible for all x and v £ R m is a new vector of control variables. 

Definition 9.1.3 (Static output feedback) 

A static output feedback for the system (3.19) is defined as 

u = a(y) (9.4) 

where a : R p i— > R m is a smooth mapping. 

Definition 9.1.4 (Static output feedback with new input) 

A static output feedback with new input v is a feedback of the form 

u = a{y)+p(y)v (9.5) 

where a : i— > R m and (3 : R p i— > R mxm are smooth mappings. Fur- 

thermore, (3(x) is invertible for all y and v £ R m is a new vector of control 
variables. 

Figure 9.1 illustrates the definition of static output feedback with new input 
by a signal flow diagram. Note that Definitions 9.1.1, 9.1.2 and 9.1.3 are all 
special cases of Definition 9.1.4. 




Figure 9.1. Static output feedback with new input 



In the case of a dynamic feedback of any type, one usually considers a new 
input. Therefore the definitions of dynamic state and output feedbacks are 
given in only one version. 
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Definition 9.1.5 (Dynamic state feedback) 

A dynamic state feedback is defined as 

z = r}(z,x)+0(z,x)v , s 

u = a(z, x) + /3(z, x)v x ' 

where 2 e I 1 , ij : R l x X 1 — > 6 : R l x X 1 — > K ixm , a : R l x X 1 — > K m 

and (3 : I'xfn R mxm are smoo i} l mappings and v £ M m is the new input 
vector. 

Definition 9.1.6 (Dynamic output feedback) 

A dynamic output feedback is defined as 

z = V(z,y) + 9{z,y)v , . 

u = a(z,y) +f3{z,y)v 

where z el 1 , rj : I 1 ^ : R l x 1 — > R lxm , a : R 1 x I p m R m 

and (3 : R 1 x R p i-> R mxm are smooth mappings and v £ K m is the new input 
vector. 

Figure 9.2 shows the signal flow diagram of a system controlled by a dynamic 
output feedback. 




In any type of feedbacks above, we can speak about: 

• Linear feedback 

When the functions a and (3 in the feedback equations are linear. 

• Full feedback 

When every entry of the signal used in the feedback (state or output) is 
taken into account when computing the input signal. 

9.1.4 Linear Static Full State Feedback Applied to SISO LTI 
Systems 

In the example of single-input-single-output (SISO) linear time-invariant 
(LTI) systems, we show how a full static feedback can be used to change 
the stability properties of the system. 
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Let us have a state-space realization (A, B, C) of a single-input-single-output 
(SISO) LTI system S: 



x(t ) = Ax(t ) + Bu(t) 
y(t) = Cx(t) 

y(t), u(t) G K, x(t) G M" 

A G M raxn , B G R” xl , C G R lx " 



with transfer function 

. b(s) bis 71 ^ 1 + ... + b n 

His ) = — = = 

a(s) s n + ais n_1 + ... + a n 

Let us modify S by a linear static full state feedback, i.e. 

v = u + kx 

k = [ ki k 2 ■ ■ ■ k n ] 

k G R lxra ( row vector) 

to get a new desired characteristic polynomial a(s) with 

deg a(s) = n 



(9.9) 



(9.10) 



The state-space description of the closed-loop system S c is 

x(t) = {A- Bk)x(t) + Bv(t) , . 

y(t) = Cx(t) 

with the closed- loop polynomial a c (s ) 

a c (s) = det (si — A + Bk) a(s) (9-12) 

while the polynomial a(s) for the open-loop system is 

a(s) = det (si — A) 

Observe that the applied linear static full state feedback influences the sta- 
bility of the system as the state matrix of the closed-loop system has changed 
to be A c i = (A — Bk). 



9.2 Pole-placement Controller for SISO LTI Systems 

Pole-placement controllers are the most simple controllers which can be ap- 
plied only to SISO LTI systems. Although their direct importance of control- 
ling nonlinear systems is not at all great, their design and properties teach 
us some important lessons. 
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9.2.1 Problem Statement 

Given a finite dimensional LTI system with realization ( A , B, C) where the 
poles of the system are determined by the polynomial a(s). Influence the poles 
by linear static full state feedback to get a specified (desired) polynomial a(s) 
such that 

deg a(s) = deg a(s) = n 

A sub-problem of this problem statement is to find a feedback that stabilizes 
the system. 

The pole-placement controller design is a simple but not very advanced 
design method to achieve the above goal. Notice that there is no explicit loss 
function expressing the control aim. This means that this type of controller 
is not an optimizing one. 



9.2.2 Solution for the SISO Case 

We use the following notations: 
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where C is the controllability matrix and Tj is a Toeplitz matrix containing 
the coefficients at of the open-loop characteristic polynomial a(s). 

With the above matrices, the state feedback parameters k resulting in a 
desired characteristic polynomial a(s) can be computed as 

k = (a-a)T ( T T C- 1 (9.13) 

where a and a are vectors composed of the coefficients of the characteristic 
polynomials cc(s) and /3(s). 

As the Toeplitz matrix Tj is always nonsingular, the right-hand side of 
the equation below is nonsingular if and only if C is nonsingular, i.e. ( A,B ) 
is a controllable pair. 

This shows that a static full state feedback can arbitrarily relocate the 
eigenvalues of a system with realization ( A,B,C ) if and only if (A, B) is 
controllable. 

It is important to note that the feedback gain k depends on the realization 
(A, B, C) because the controllability matrix C depends on it. 

The software package MATLAB® has a simple procedure call (place) to 
compute the feedback gain vector from the state-space representation matri- 
ces of the open-loop system and from the desired poles. 
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Example 9.2.1 (LTI pole- placement controller) 

Pole-placement controller design for a simple LTI system 

Consider a simple single-input-single-output LTI system in the 
form of Equation (9.8) with the matrices 



A = 



3 4 
56 ’ 




C=[l 0] 



(9.14) 



Let the desired poles of the closed-loop system be —1 and —3. It 
is easy to check that the eigenvalues of the state matrix above are 
Ai = 7.5 , A 2 = 2.5, that is, the system is unstable. 

Then the pole-placement controller design procedure checks the 
full rank of the controllability matrix and gives the following feed- 
back gain vector: 



k = [0.5455 1.2727] 



(9.15) 



9.3 LQR Applied to LTI Systems 

The Linear Quadratic Regulator (LQR) is one of the most commonly used 
and powerful ways of controlling linear systems. Its extensions are available 
for stochastic or discrete time systems, as well as for the servo case. Nonlinear 
systems are also often controlled by LQRs. 

9.3.1 Problem Statement 

Given a multiple-input-multiple-output (MIMO) LTI system in the following 
state-space representation form: 

x(t) = Ax(t ) + Bu(t), x(0) = x 0 . , 

y(t) = Cx(t) (9 - 16) 

Define the functional J(x,u) as follows: 

1 r T 

J(x,u) = - / [x T (t)Qx(t) + u T (t)Ru(t)]dt (9-17) 

2 J 0 

with the positive semi-definite state weighting matrix Q and the positive 
definite control weighting matrix R. Note that the first term in the integrand 
above measures the derivation of the state from the reference state Xd = 0 
and the second term measures the control energy. 
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It is important to note that both terms in Equation (9.17) are quadratic 
forms in the form of x T Qx = YJiij=i x iQij x ji which is a scalar- valued positive 
function for any x if the matrix Q is positive definite. 

The control problem is to find a control input {u(t), t € [0,T]} that 
minimizes J subject to Equation (9.16) (constraint on the state variables). 



9.3.2 The Solution Method: Calculus of Variations 



The solution of the LQR control problem as an optimization problem is based 
on the calculus of variations. 

Our previous problem can be generalized to the following mathematical 
problem: 

Minimize 



f T 

J(x,u) = / F(x,u,t)dt 
Jo 



(9.18) 



with respect to u subject to x = f(x,u,t). 

Adjoin the constraint f(x, u,t) — x = 0 to the cost J(x, u) using a vector 
Lagrange multiplier A(.) to obtain 



J(x,x,u)= I [F(x,u,t) + A t (t)(f(x,u,t) — x)]dt 
Jo 

which will be minimized with respect to u(t). Further define 

H = F + X T f 

as the Hamiltonian function to the optimal control problem. 

Integrating Equation (9.19) by part and substituting H , we obtain 



(9.19) 



J= f [H + X T x\dt — [X T x\ 
Jo 



T„iT 
0 



If a minimizing u were found, then an arbitrary Su in u should produce 
6J = 0: 

rT \,dH - T . r dH 1 

{ sr + A )Sx + sr Su 



SJ = — X T 5x\q + 



dt 



The variation SJ above is equal to 0 if and only if the two variations in the 
integrand above are equal to 0. 

Euler-Lagrange Equations. The above condition on minimality of SJ re- 
sults in the so-called Euler-Lagrange equations 




214 9. State Feedback Controllers 



The Euler-Lagrange equations for the LTI case are in the following form 
using 

x t Qx ) = 2 x t Q 

X T + x t Q + A t A = 0, A (T) = 0 (9.21) 

u = -R~ 1 B t A (9.22) 

with the system model 

x = Ax(t) + Bu(t), x(0) = xq (9.23) 



From the equations above, we get 



'x{ty 




' A -BR~ l B T ' 


x(t) 


II 

B 

o 


|>(t)J 




-Q - A T 




’ A (T) = 0 



(9.24) 



Note that the first equation in the vector differential equation above describes 
the system dynamics and the second one is the so-called Hammerstein co- 
state differential equation. 

The above formalism adjoins a co-state variable A to the original state 
variable x for which the following basic lemma holds: 

Lemma 9.3.1. If(A,B) is controllable and (C. A) is observable, then 



A (t) = K(t)x(t) 
where matrix K(t ) € 7 Z nxn 



(9.25) 



Having the above important lemma, we can substitute Equation (9.25) into 
Equation (9.21) to obtain 

Kx + Kx = — A T Kx — Qx 



If we substitute further Equation (9.23) into x in the equation above, we get 

Kx + K[A - BR~ 1 B t K]x + A T Kx + Qx = 0 

for any x(t). Therefore the following Matrix Ricatti Differential Equation 
holds for K(t) as an independent variable: 

K + KA + A T K - KBR~ 1 B t K + Q = 0 



(9.26) 
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Special Case: Stationary Solution. Let us take the special case T — > oo, 
which is called the stationary solution when 



/»00 

J = / ( x t Qx + u T Ru)dt 

J o 



One can prove that in this case 

lim K(t) = K i.e. K = 0 

t—>oo 

where K is a constant matrix. 

Then Equation (9.26) specializes to the following equation called the Con- 
trol Algebraic Ricatti Equation (CARE): 

KA + A t K - KBR~ 1 B t K + Q = 0 (9.27) 

It is easy to see that by taking the transpose of the equation above that K 
is symmetric. 

Let us choose Q = C T C. Then 

nO O /*00 

J(x,u) = / (x T C T Cx + u T Ru)dt = / ( y T y + u T Ru)dt (9.28) 

J o J o 

Theorem 9.3.1. (Due to R. Kalman). If (C,A) is observable and ( A,B ) is 
controllable then CARE has a unique positive definite symmetric solution K. 



9.3.3 LQR as a Full-state Feedback Controller 

With this optimal solution, the optimal feedback is a full state feedback (from 
Equations (9.25) and (9.22)) in the form 

u°(t) = - RT 1 B T Kx(t ) = —Gx(t) (9.29) 

where G = R~ 1 B T K. 

With the optimal feedback above, the closed-loop system equations are as 
follows: 

x = Ax — BR^ 1 B t Kx = (A — BG)x , a;(0) = xo 

y = Cx 

Properties of the Closed-loop System. The closed-loop LTI system con- 
trolled by an LQR has the following remarkable properties: 

• The closed-loop system is asymptotically stable, i.e. 

Re Aj (A — BG ) <0, * = 1,2, ..., n 

• Stability of the closed-loop system is guaranteed by LQR no matter what 
the values of A, B,C,R and Q are. 
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• With A, B given, the specific location of the closed-loop poles depend on 
the choice of Q and R ( i.e . Q and R are the design parameters). 

The software package MATLAB® has a simple procedure call (lqr) to com- 
pute the feedback gain vector from the state-space representation matrices of 
the open-loop system and from the weighting matrices in the loss functional. 



Example 9.3.1 (LQR for an LTI system) 

LQR design for a simple LTI system introduced in Example 9.2.1 

Consider a simple single-input-single-output LTI system in the 
form of Equation (9.8) with the matrices in Equation (9.14). 

Let the weighting matrices in the loss function (9.17) be as follows: 



This means that we weight the error in the state as being much 
higher than the energy put in for changing the input. 

Then the LQR design procedure in MATLAB® gives the following 
feedback gain vector: 

k = [ 0.9898 0.8803 ] (9.32) 

The poles of the closed-loop system 

[ - 15.2021 - 8.7690 ] 

have indeed negative real parts, which means that the closed-loop 
system is stable. 



R= [0.5' 



(9.31) 



9.4 Hamiltonian View on Controlled Systems 

In this section it is shown how the Hamiltonian view can be applied to de- 
riving controllers by constructing a Hamiltonian description of controlled 
systems. 

The direct relationship with classical mechanics described in Section 8.3 
will be used here in the context of LTI systems where a quadratic Lyapunov 
function can always be constructed (see Theorem 7.3.3 in Chapter 7). There 
is also a relationship with the well-known formulation of designing LQR con- 
trollers for LTI systems. 
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Hamiltonian Formulation of Input Design. Let us choose the Hamil- 
tonian function of a concentrated parameter system in the following form: 

H(x,u, A, t) = F(x,u,t) + X T (t)f(x,u,t), A (t) = p(t) (9.33) 

where the state equation of the system is 

x = f(x,u,t ), x(0) = Xq (9.34) 

We aim at finding an input u such that the functional 

J(x,u) = [ F(x,u,t)dt — > min . (9.35) 

Jo neC 2 [0,T] 

is minimized. Here F(x,u,t) is a given optimality criterion, the analog for 
potential energy, while X T (t)f(x,u,t) corresponds to the kinetic energy. 

Let us investigate the relationship of the Hamiltonian I\ 1 in Equation (8.8) 
of Section 8.3 derived from the storage function and the definition of H in 
Equation (9.33) with the special case of input-affine nonlinear state-space 
models, when f(x,u,t ) = fix) + g(x)u. Comparing the equations, we find 
that 

A = P = Vj (9.36) 

F(x,u,t) = -^[ 7 2 |M| 2 - h T (x)h(x)] (9.37) 

Observe that F(x,u,t) is the supply rate and the co-state variable plays the 
same role as before, joining the right-hand side of the state equation to the 
Hamiltonian. 

From the above, it follows that if we manage to choose the optimality 
criterion for a controller such that a storage function can he derived from 
it in the same way as (9.3 7), then the controller will stabilize the original 
system. 

The LTI Case. This is exactly the case of LQR for LTI systems as was seen 
in Section 9.3 before. In this case 

F(x, u, t) = x t Qx + u T Ru 

which is in good agreement with the open-loop natural Lyapunov (storage) 
function 

V(x) = x T Px 

With the Hamiltonian view on controlled systems, we can derive the so- 
called Hamiltonian equations in the following way. We adjoin the constraint 
f(x,u,t) — x = 0 to the cost J(x, u) by using a vector Lagrange multiplier 
A(.) to obtain 
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J(x,x,u) = f [F(x,u,t) + X T (t)(f(x,u,t) — x)]dt (9.38) 

Jo 

which will be minimized with respect to u(t). Integrating Equation (9.38) by 
part and substituting H , we obtain 



J = / [H + A T x\dt — [A t x] q 
Jo 



If a minimizing u were found, then an arbitrary Su in u should produce 
6J= 0: 



SJ = —\ t 5x\q + j 
Jo 



,‘dll 



dH 



C-g + 



dt 



The variation 5J above is equal to 0 if and only if the two variations in the 
integrand above are equal to 0. 

The Hamiltonian equations relate the state and co-state variables as fol- 
lows: 



dF[(x,p,u) 
X ~ dp 


(9.39) 


dF[(x,p,u) 
P= dx 


(9.40) 



where A = p. 

The necessary condition for the optimality of control u*(t), t £ [0,T] is: 



dH(x,p,u) = 
du 



(9.41) 



The Euler-Lagrange equations can be derived from (9.40) and (9.41) and 
from the defining Equation (9.33): 



d F 
dx 



dx 



A + A = 0 



d if + d -f^ a 



(9.42) 

(9.43) 



It is important to note that now we have arrived at the same equations 
as before in Equations (9.20) in Section 9.3 where they have been obtained 
by solving a control optimization problem using calculus of variations. 

The solution of the Euler-Lagrange equations above is performed for LTI 
systems in Section 9.3 before assuming that 



A (t) = K(t)x(t) 



(9.44) 



where K is a suitable time-dependent square and symmetric matrix. 
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9.5 Case Study: Linear Full-state Feedback Control of a 
Continuous Fermenter 

The usual way of approaching a nonlinear system to be controlled is to start 
with a robust linear full-state feedback controller which is designed by using 
a linearized model of the system around a nominal operating point. Then 
the stability region of the closed-loop controlled system can be estimated by 
using quadratic Lyapunov functions (see Subsection 7.3.2 for details). 

The aim of this section is to show the possible difficulties which can be 
met using this linearized approach [76]. 

The simple continuous fermenter is used here for this purpose. The input- 
affine nonlinear state-space model of the fermenter is developed in Subsection 
4.5.3 and is given in Equations (4.78)-(4.79). The variables and parameters 
of the fermentation process model are collected in Table 4.1. 

The linearized state-space model of the continuous fermenter is also de- 
veloped in Equations (4.84)-(4.87). 



9.5.1 Pole-placement Controller 

The purpose of this section is: 

• to provide a simple controller design approach for later comparison, 

• to examine the possibilities of stabilizing the system by partial feedback 
(preferably by feeding back the substrate concentration only). 

Pole- placement by Full State Feedback. First, a full state feedback is 
designed such that the poles of the linearized model of the closed-loop system 
are at [—1 — 1.5] T . The necessary full state feedback gain is 

K pp = [-0.3747 0.3429] (9.45) 

A simulation run is shown in Figure 9.3 starting from the initial state A(0) = 
0.1| and S'(O) = 0.5|. It is clearly seen that the closed-loop nonlinear system 
has an additional undesirable stable equilibrium point and the controller 
drives and stabilizes the system towards this point. This stable undesired 
operating point can be easily calculated from the state equations and the 
parameters of the closed-loop system: X = 3.2152 1, S = 3.5696 y . The time 
derivative of the Lyapunov function is shown in Figure 9.4. The appearance of 
the undesired stable operating point warns us not to apply linear controllers 
based on locally linear models for a nonlinear system without careful prior 
investigation. 

Partial Linear Feedback. Motivated by the fact that the zero dynamics 
of the fermenter (see Subsection 5.5.2 for details) is globally asymptotically 
stable when the substrate concentration is the output, let us consider the 
following static partial state feedback: 
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Figure 9.3. Centered state variables and input, full state feedback pole-placement 
controller, X(0) = O.ly, S'(O) = 0.5y 



u = Kx 



where K = [0 k], i.e. we only use the substrate concentration for feedback. 

The stability region of the closed-loop system is investigated by using the 
time derivative of the quadratic Lyapunov function. Figure 9.5 shows that 
the stability region of the closed-loop system is quite wide. Furthermore, it 
can be easily shown that for, e.g. k = 1, the only stable equilibrium point of 
the closed-loop system (except for the wash-out steady state) is the desired 
operating point. The eigenvalues of the closed-loop system with k = 1 are 
-0.9741 and -2.6746. 



9.5.2 LQ Control 

Usually the well-known LQ-controller is used as a reference controller for com- 
parison and tuning the nonlinear controllers. LQ-controllers are popular and 
widely used for process systems. They are known to stabilize any stabilizable 
linear time-invariant system globally, that is, over the entire state-space. This 
type of controller is designed for the locally linearized model of the process 
and minimizes the cost function 
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1 1 



Figure 9.4. Time derivative of the Lyapunov function as a function of centered 
state variables q\ = 1,92 = 0.1, pole-placement controller, K pp = [—0.3747 0.3429] 

/»oo 

J(x(t),u(t)) = / (x T (t)R x x(t) + u T (t)R u u(t)) dt (9.46) 

Jo 

where R x and R u (the design parameters) are positive definite weighting ma- 
trices of appropriate dimensions. The optimal input that minimizes the above 
functional is in the form of a linear full state feedback controller u = —Kx. 
The results for two different weighting matrix selections are investigated. 

Cheap Control. In this case, the design parameters R x and R u are selected 
to be R x = I 2x2 and R u = 1. The resulting full state feedback gain is K = 
[-0.6549 0.5899]. 

Expensive Control. The weighting matrices in this case are R x = 10 • 
I 2x2 and R u = 1. There are no significant differences in terms of controller 
performance compared to the previous case. The full state feedback gain in 
this case is K = [-1.5635 2.5571]. 

The stability region is again investigated using the time derivative of 
a quadratic Lyapunov function. The time-derivative function as a function 
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Figure 9.5. Time derivative of the Lyapunov function as a function of centered 
state variables qi = 1 , 52 = 0.1, partial linear feedback, k = 1 



of the centered state variables for cheap and expensive control is seen in 
Figures 9.6 and 9.7 respectively. Unlike the linear case where LQR always 
stabilizes the system, it is seen that the stability region does not cover the 
entire operating region. Indeed, a simulation run in Figure 9.8 starting with 
an “unfortunate” initial state exhibits unstable behavior for the nonlinear 
fermenter. 

Note that an LQ-controller is structurally the same as a linear pole-placement 
controller (i.e. a static linear full state feedback). Therefore undesired stable 
steady states may also appear depending on the LQ-design. 



9.6 Further Reading 

[64] discusses multivariable controller design methods for linear systems with 
several process system case studies. One of the most popular books of the 
recent decade on linear controller design is [48]. The first papers of great 
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Figure 9.6. Time derivative of the Lyapunov function as a function of centered 
state variables qi =T,Q 2 = 1, LQ-controller, cheap control 



influence on optimal control were [40] and [41] . The LQR problem is covered 
in great detail in, e.g. [6]. 

Classical control-related problems for LPV systems are solved in [78], [74] 
and [69] using a geometric approach. 



9.7 Summary 

The basic notions of controller design, including feedback of different types, 
control design by optimization and the Hamiltonian view on controlled sys- 
tems, are described in this chapter. 

The most simple linear controllers, the pole-placement controller and the 
linear quadratic regulator (LQR) are also introduced here as applied to LTI 
systems. 

A case study of a simple nonlinear continuous fermenter model is used 
to illustrate how to design and use linear controllers to nonlinear process 
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Figure 9.7. Time derivative of the Lyapunov function as a function of centered 
state variables q\ = l. q? = \ , LQ controller, expensive control 



systems and what the dangers are of applying them without careful prior 
investigation. 



9.8 Questions and Exercises 

Exercise 9.8.1. Compare the pole-placement and LQR design for LTI sys- 
tems using Examples 9.2.1 and 9.3.1. Comment on the similarities and dif- 
ferences. 

Exercise 9.8.2. Classify controllers according to their control aim. Give 
simple example (s) to each of your class. 

Exercise 9.8.3. Give the joint necessary condition of the applicability of 
pole-placement controllers and LQR in the case of LTI systems. 
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Time [h] 



Figure 9.8. Unstable simulation run, LQ-controller, expensive control, X(0) = 
O.lf, S{0) = 0.5f 



Exercise 9.8.4. Explain the significance and use of the Hamiltonian de- 
scription in controller design for both the LTI and the nonlinear input-affine 
case. 



Exercise 9.8.5. The state-space model of a linear system is given by the 
following matrices: 



A = 



1 0 
0 2 





(9.47) 



Calculate the state feedback gain such that the poles of the closed-loop system 
are at [—1 — 2] T . 

Exercise 9.8.6. Consider a first-order process with the state-space realiza- 
tion 



x(t) = x(t) + u(t ), y(t) = x(t) 

Calculate the optimal state feedback gain that minimizes the functional 

/»oo 

J(x(t),u(t)) = / x(t) T Qx(t) + u(t) T Ru(t)dt 

Jo 

for the following cases: 



(9.49) 
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• Q = l, R . = 1 

• Q = l, R .= 10 

• <2 = 1, i? = o.i 

• <2 = 10, R = 1 

Examine the poles of the closed- loop systems for the above four cases. Which 
control is the cheapest if we consider the cost of input energy? Which one 
provides the quickest response? 



Exercise 9.8.7. Consider the state equation of the simple quasi-polynomial 
system in Exercise 6.9.4 in the form of 

dx\ 
dt 



1/2 3/2 



X\x\ 



1/2 



Ml 



= ?>X\X^ 2 — 2x\x-2 



with the output equation y = x i. 

Design a stabilizing pole-placement controller for the system in the fol- 
lowing steps: 

1. Apply the nonlinear coordinate transformation (see Definition 3.5.2) 



<P(x) 



ln(a:i) 

ln(aj 2 ) 



to the state equation to get a LTI model in the new coordinates. 

2. Design a pole-placement controller in the new coordinate system moving 
the poles to [—1, — 1]. 

3. Express the resulted feedback in the original coordinates. 

Characterize the feedback you have obtained. 



Exercise 9.8.8. What is a joint necessary condition of the applicability of 
pole-placement control and LQR in the case of LTI systems? 
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The aim of linearization is to apply a suitable nonlinear coordinate trans- 
formation to a nonlinear system in order to obtain a linear one in the new 
co-ordinates. As will be shown in this chapter, the coordinates transformation 
must be supplemented by a static nonlinear feedback to achieve linearization. 
Therefore it is a basic but limited technique for control of nonlinear systems. 

The description in this chapter mainly follows the well-known book of 
Isidori [37]. The material is broken down into the following sections: 

• Relative degree 

We start with the notion and computation of the relative degree of a SISO 
nonlinear system, which is one of the basic properties of a nonlinear system. 

• Exact linearization via state feedback 

The exact linearization procedure is described in detail and illustrated with 
examples. 

• Input-output linearization 

Input-output linearization is applied when exact linearization is not appli- 
cable or not feasible, therefore it is of great practical importance. 

• Process systems with maximal relative degree 

The engineering conditions of process systems, being of maximal relative 
degree, are investigated in this section. This property is required for the 
application of the basic case of feedback linearization. 

• Case study: feedback and input-output linearization of a continuous fer- 
menter 

The controller design techniques based on feedback and input-output lin- 
earization of a simple continuous fermentation process are described and 
compared here. 

• Output selection for feedback linearization 

This section deals with a controller structure selection problem on how to 
select a suitable output from the possible ones for feedback linearization. 



10.1 Relative Degree 

The notion of relative degree plays a central role not only in the necessary 
condition for performing exact linearization but also in other parts of nonlin- 
ear control theory. This is the reason why the notion of relative degree has 
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been introduced earlier by Definition 5.5.2 in Section 5.5, which is repeated 
here for convenience. 

The single-input-single-output nonlinear system 
x = f (x) + g(x)u 
y = h{x) 

is said to have relative degree r at a point x° if 

1. L g L k fh(x) = 0 for all x in a neighborhood of x° and all k < ) — 1. 

2. L g L r f l h{pP) ± 0. 



Here it is important to remember that the relative degree r is exactly equal 
to the number of times one has to differentiate the output y(t) at time t = t° 
in order to have the value u(t°) explicitly appearing. 

To show this, we first observe that the function g{x) in Equation (5.51) 
(repeated above) is vector- valued, that is 



g(x) 



9i(x) 

g n {x) 



Then we compute the time derivative of the output equation several (fc) times 
as follows: 

• k = 0: y = h(x) 

dy dh . dh . , . . . . 

7t = ai x = di (/(l) + = L ’ h + L ‘ h ' " 

• k = 1: assume L g h = 0 (condition 1) then y = Lfh, and 

( f ( x ) + 9 (x)u) = L)h + L g L f h ■ u 

If LgLfh ^ 0 then r = 2 (see condition 2), otherwise we continue the 
procedure, and so on. 



Note that for MIMO systems the relative degree can be defined pairwise for 
all of the possible input-output pairs. 

The following simple example shows how the concept of relative degree 
applies for SISO LTI systems. 
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Example 10.1.1 (Relative degree of SISO LTI systems) 

Relative Degree of Linear Time-invariant Systems 



Let us consider the following SISO LTI system: 

x = Ax+Bu (10.1) 

y = Cx (10.2) 

It is easy to see that 

L)h{x) = CA k x (10.3) 

and 

L g L)h{x) = CA k B (10.4) 

Notice that the relative degree conditions depend on the Markov 
parameters of an LTI SISO system. 

Thus the relative degree r is given by 

CA k B = 0 Vfc<r- 1 (10.5) 

CA r ~ 1 B ^ 0 (10.6) 



It is well known from linear systems theory that the integer 
satisfying these conditions is exactly equal to the difference be- 
tween the degree of the denominator polynomial (n) and the de- 
gree of the numerator polynomial (m) of the transfer function 
H(s) = C(sl — A)~ 1 B , i.e. r = n — m> 0. 



The next example contains the calculation of relative degree for a simple 
nonlinear system. 



Example 10.1.2 (Relative degree of a nonlinear system) 



Calculate the relative degree of the following system at the point 

[1 1 ] T . 





X2 




'O' 


X = 


2w<C(l — yx\)x2 — to 2 X\ 


+ 


1 



y = h(x) = x\ (10.8) 



where to, £ and y are non-zero constants. If possible, find two 
points in the state-space where the relative degree of the system 
is different. 
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We compute the necessary Lie-derivatives as follows: 

= 0 (10.9) 

L f h(x) = x 2 (10.10) 

= 1 ( 10 . 11 ) 

This means that the relative degree of the system is 2 in any point 

of the state-space (including [1 1] T ). Therefore there are no such 
points in the state-space where the relative degree of the system 
is different. 



LgLfKx) = g(x ) = [0 1] 



dh 



'gh 0) = fa.9( x ) = I 1 °] 



10.2 Exact Linearization via State Feedback 

The aim of exact linearization is to apply a suitable nonlinear static state 
feedback to a SISO nonlinear system in order to obtain a linear one in the 
new coordinates and between the original output and the newly introduced 
transformed input. Thereafter any controller design method, such as PID, 
pole-placement or LQR, applicable for SISO LTI systems can be used to sta- 
bilize the system or modify its dynamic properties (see Chapter 9 for state 
feedback controllers for LTI systems). 

Exact linearization via state feedback is a basic but limited technique for 
control of nonlinear systems because it is only applicable for systems satisfying 
a relative degree condition. 



10.2.1 Nonlinear Coordinates Transformation and State Feedback 

In a SISO system the most convenient structure for a static state feedback 
control is when the input variable u is computed as 

u = a(x)+0(x)v (10.12) 

where v is the external reference input. The composition of this control with 

a SISO nonlinear input-affine system of the form (5.51)-(5.52) gives 

x = f(x) + g(x)a(x) + g(x)(3(x)v (10.13) 

y = h(x) (10.14) 

The application that will be discussed is the use of state feedback (and change 
of coordinates in the state-space) with the purpose of transforming a given 
nonlinear system into a linear and controllable one. 
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Note that the above nonlinear state feedback is a direct extension of the 
linear state feedback (see in Section 9.1.2) applied in the problem statement 
of pole-placement controllers described in Section 9.2: 

u = —kx + v (LTI) 
u = a(x ) + (3{x)v (nonlin) 



The following lemma introduces a coordinate transformation that is applied 
in bringing the system into a linear form in the new coordinates. 



Lemma 10.2.1. Consider a nonlinear system having relative degree r = n 
(i.e. exactly equal to the dimension of the state-space) at some point x = x° 
and the following coordinates transformation: 









h(x) 


<h(x) = 




= 


Lfh(x) 




_4’n{x)_ 




_L n f 1 h(x)_ 



(10.15) 



i.e. a transformation by the output function and its first (n — 1) deriva- 
tives along f(x). Then there exists a nonlinear static feedback in the form 
of (10.12) such that the closed-loop system in the new coordinates is linear 
and controllable. 



In the new coordinates 

ri-l 



Zi = <t>i(x) = L) l h( x), 1 < i < n 

the system is given by 



zi = 22 
22 = 2 3 



Zn — 1 z n 

z n = b(z ) + a(z)u 



since 



sdMx) = 



dL)h{x) . dL)h{x) 



dx 

-k+lr 



-X = 



dx 

r k i 



(/(*) + 9(x)u) 



= L k + l h{ x) + L g Lfh(x)u 
As the relative degree of the system is equal to n 

L g L k fh(x) =0, V/c < n 



(10.16) 



(10.17) 

(10.18) 

(10.19) 

( 10 . 20 ) 
( 10 . 21 ) 



(10.22) 



the above Equation (10.22) specializes to 
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^L k fh( x) = Zk = L k+1 h{x) = Zk+ 1 , Vfc < n (10.23) 

and the last equation is in the form 

in = + L g L n f l h{ x) ■ u (10.24) 

Suppose that the following state feedback control law is chosen: 

U = — r-r(- b(z) + v) (10.25) 

a{z) 

with 



, , _ b{z) _ L f h {x) 1 1 

a[X> a(z) LgL^Kx)' P[X> a(z ) LgL^h^x) 

as follows from Equation (10.24) above. 

The resulting closed-loop system is then governed by the equations 



Zi 


Z2 


(10.26) 


Z2 


= z 3 


(10.27) 






(10.28) 


Zn—1 


= z n 


(10.29) 


Zn 


- V 


(10.30) 



i.e. the closed-loop system is indeed linear and controllable. 

It is important that the transformation consists of two basic ingredients: 

1. A change of coordinates, defined locally around the point x°. 

2. A state feedback, also defined locally around the point x°. 

10.2.2 The State-space Exact Linearization Problem for SISO 
Systems 

A critical assumption in Lemma 10.2.1 is to have the relative degree of the 
system to be equal to the number of state variables, i.e. r = n. If this is 
not the case, i.e. when r < n, one may try to construct an artificial output 
y = A(x) (with A(a’) being a nonlinear function different from the original 
h(x)) such that the relative system is of r = n. The idea is to use the basic 
case given in Lemma 10.2.1 to find conditions for the existence and a way to 
construct A(x). 

It is important to note, however, that A(x) is not expected to be unique (if 
it exists at all) because the nonlinear coordinates transformation <P(x) is not 
unique either. Therefore we would like to find a transformation <P(x) which 
is simple and invertible. 
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Problem Statement. Consider an input-affine nonlinear system model 
without the output equation 



x = f(x ) + g{x)u (10.31) 

and suppose the following problem is to be solved. Given a point x° in the 
state-space, find (if possible) a neighborhood U of a; 0 , a feedback 

u = a(x) + P(x)v (10.32) 

defined on U , and a coordinates transformation z = <P(x) also defined on U, 
such that the corresponding closed-loop system 



|^(/(z) +9{x)at{x)) 



)v 


(10.33) 


linear and controllable, i.e. 




II 


(10.34) 


= B 


(10.35) 



J X— t P~ 1 (z) 

d<P 

g-(9( x )f3(x)) 

UX J x =&- l (z) 

for some suitable matrix A £ R nxn and vector B £ R” satisfying the condi- 
tion 



rank(l? AB . . . A n 1 B) = n (10.36) 

This problem is the SISO version of the so-called State-space Exact Lineariza- 
tion Problem. 

Existence of a Solution. The following lemma gives a necessary and suf- 
ficient condition for the solvability of the above State-space Exact Lineariza- 
tion Problem: 



Lemma 10.2.2. The State-space Exact Linearization Problem is solvable if 
and only if there exists a neighborhood U of x° and a real-valued function 
defined on U, such that the system 

x = f{x) + g{x)u (10.37) 

y = \{x) (10.38) 

has relative degree n at x°. 

The problem of finding a function A such that the relative degree of the 
system at x° is exactly n, i.e. a function such that 

LgX(x) = L g Lf\(x) = ■ ■ ■ = LgL‘ n f~ 2 \(x) = 0 for all x 

LgL ]- 1 X(x°) ^ 0 



(10.39) 

(10.40) 
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is apparently a problem involving the solution of a system of partial differ- 
ential equations (PDEs). 

In order to see this, we rewrite the first equation in (10.39) into PDE form 
using the fact that \(x) = A(aq, . . . , x n ) is a scalar- valued function: 



d\ 



L gKx) = Y faT.W ' 9i( x ) = 0 



with gi(x) being a given function. 

For the purpose of the solution we introduce a short notation 



Lad f gX = — ■ [/, g] 

where aclyg is recursively defined as follows: 
ad° f g{ x) = g{x) 
ad)g(x) = [ f,ad l f ~ 1 g{x )] 

For example 



ad)g{: r) = ad f g = [/, g], ad)g{x) = [/, [/, g]\ 

As a matter of fact, Equations (10.39) are then equivalent to 



(10.41) 



(10.42) 

(10.43) 



L g \(x) = L adfg X(x) = ■■■ = L ad n~ 2 g X(x) = 0 (10.44) 

and the non-triviality condition (10.40) is equivalent to 

L ad ^ g KA ^ 0 (10.45) 

By this, we have arrived at a theorem that states the necessary and suf- 
ficient conditions for the solvability of the State-space Exact Linearization 
Problem: 



Theorem 10.2.1. Suppose a system 
x = f(x) + g(x)u 



(10.46) 



is given. The State-space Exact Linearization Problem is solvable near a point 
x° (i.e. there exists an “ output ” function X for which the system has relative 
degree n at x°) if and only if the following conditions are satisfied: 

1. The matrix A c (x°) = g(x°) adfg(x°) ... ad^~ 2 g(x°) ad^~ 1 g(x°) has 
rank n. 

2. The distribution D = span{g, adfg , . . . , ad^~ 2 } is involutive near x° . 
The distribution D in condition 2 can also be written in the form 



D = span{ g, [ f,g ], [f,[f,g}\, ...} 

and its dimension is at most n — 1, i.e. dim D < n — 1. The difficulty in 
constructing D lies in the fact that it is difficult to have it involutive. 
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Solution Procedure. On the basis of the previous discussion, the proce- 
dure leading to the construction of a feedback u = a(x ) + (3(x)v and of a 
coordinates transformation 2 = <P(x ) by solving the State-space Exact Lin- 
earization problem consists of the following steps: 

1. From /( x) and g( x), construct the vector fields 

g(x),ad f g(x), ..., ad^ 2 g(x),ad n f ~ 1 g(x) 
and check conditions 1 and 2. 

2. If both are satisfied, solve the partial differential equation (10.39) for 

A(a;). 

3. Calculate the feedback functions 



a(x) 



-L n f X(x) 
L g L]~ 1 X(x) ’ 



0(x) 



1 

LgL^Xix) 



4. Calculate the coordinate transformation 



(10.47) 



T>(x) = col(X(x),L f X{x), ..., L]- 1 X(x)) 



(10.48) 



Definition 10.2.1 (Linearizing feedback and coordinates) 

The feedback defined by the functions (10. 4 7) is called the linearizing feedback 
and the new coordinates given by (10. 48) are called the linearizing coordi- 
nates. 



It is important to note that the feedback linearization of SISO nonlinear sys- 
tems is not necessarily robust (sometimes even highly sensitive) with respect 
to the parameter or structure mismatches, therefore it is of limited use in 
process system applications. 



10.2.3 Simple Examples for Feedback Linearization 

Two simple examples shows the difficulties of feedback linearization using the 
solution procedure of the State-space Exact Linearization Problem. 

Linearization of a One-dimensional System 

Problem Statement. Consider a nonlinear system that is given by the follow- 
ing state equation 

^ = — kx 2 + xu (10.49) 

where k is a non-zero constant. We aim to find a linearizing feedback and a 
linearizing coordinate transformation for this system. 

The solution proceeds by answering the following questions and solving 
the simple sub-problems as detailed below. 
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1. Is it possible to solve the State-space Exact Linearization Problem at any 
point of the state-space? 

2. Choose an appropriate point in the state-space and find a linearizing 
feedback and linearizing coordinate transformation for the system. Write 
the equations of the closed-loop system in the original coordinates and 
also in the transformed coordinates. Examine the stability, controllability 
and observability of the closed-loop system. 

3. Is the above solution unique? If not, try to give another solution. 

Solution. We solve the problem in the order of the steps above as follows: 

1. If the function A is chosen, for example, as 



A(;r) = x 



(10.50) 



then the State-space Exact Linearization Problem can be solved around 
any point of the state-space except 0, since 

L g X(x) = L g L° f X(x) = x (10.51) 

LfX(x) = -kx 2 (10.52) 

(10.53) 

2. Thus the linearizing feedback around any point (except 0) is given by 



hr 2 

a(x) = = kx 

x 

m = - 

X 

and the linearizing coordinate transformation is 
z = 4>(x) = x 



(10.54) 

(10.55) 

(10.56) 



Since the above coordinate transformation is identical, the state equation 
of the closed-loop system is the same in the original and the transformed 
coordinate is in the form 



3 . 



x = — kx 2 + x{kx H — v ) = v 
x 

The closed-loop system is on the boundary of stability, and it is 
lable and observable. 

The above solution is not unique, we can find infinitely many 
transformations, e.g. 



(10.57) 

control- 

suitable 



A(x) = x 2 + 1 
LgX(x) = 2x 2 
LfX(x) = —2kx 3 



a{x) 



2kx 3 

2x 2 



f3{x) 



1 

2x? 



kx 



(10.58) 

(10.59) 

(10.60) 

(10.61) 

(10.62) 
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Then the equations of the closed-loop system are 



X = —kx 2 + x(kx + zr-^v) = — V 
2x z 2x 


(10.63) 


z = (j>(x) = x 2 + 1 


(10.64) 


z = 2xx = v 


(10.65) 



Exact Linearization of a Two-dimensional System 

Problem statement. The aim in this example is to exactly linearize the fol- 
lowing simple two-dimensional system around its equilibrium point Xq = 0: 



x\ 

x 2 



—x\ + x 2 
— X\X2 




(10.66) 



Solution. First, let us find a function A for which the system has relative 
degree 2 at So- For this, we would need L g X(x) = 0 in a neighbourhood of xo, 
and L g LfX(xo) ^ 0. It’s easy to see from g(x) in the model that a function 
A depending only on xi meets the first requirement. Let us select A as 



A(x) = Xi 

and thus L g A(x) = [1 0][0 1] T = 0. Now, calculate L g Lf A, which is written 
as 

L g L f X(x) = [-3x? 1][0 1] T = 1 



and which satisfies the second condition of having relative degree 2 at any 
point of the state-space. The linearizing coordinates transformation <P and 
its inverse are given by 



Zl 


= <P(x) = 


Xi 


_ z 2_ 




— xf + x 2 



and 



Xi 


= <P x {z) = 


Zl 


_ x 2 _ 




[z 2 + z{ \ 



The functions in the nonlinear linearizing feedback can be calculated as 
— L 2 A(x) 



(*) = T t \ ( \ = 3a hOi - x 2 ) - x lX2 
LgLf A(x) 



and 



0(x) = t t \ ( \ = 1 
LgLfXyx) 



The system with the feedback above in the original coordinates is 
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X\ = —xf + X2 

X2 = —3Xi(Xi — X 2 ) + v 

The derivatives of the transformed coordinates are calculated as 

Z\ = -x\ +X 2 = Z 2 
Z2 = — • X\ + X2 = V 

Therefore we can conclude that the system is linear and controllable in the 
transformed coordinates with the calculated feedback. 



10.3 Input— output Linearization 

As we have seen in the previous section, the conditions of the solvability of the 
State-space Exact Linearization Problem in Theorem 10.2.1 are strict and, in 
general, the PDE (10.44) is difficult to solve analytically. Therefore the exact 
linearization may not be applicable or may not be feasible in practical cases. 
Input-output linearization is an alternative way of achieving linear behavior 
of a system by nonlinear coordinate transformation. 

Recall from Subsection 5.5.1 that any input-affine state-space system 
model with relative degree r (with r < n) can be transformed into normal 
form described in Equations (5.53) where the first r transformed coordinates 
form a linear and controllable subsystem. One can then calculate u such that 
z r = v. This gives 

u = ——r(—b(z) + v) (10.67) 

a(z) 

and 

zi = z 2 
Z2 = Z 3 

Z'p — ]_ — Z'f' 

z r = v ( 10 . 68 ) 

Zr+l = Qr+l(z) 

Z n = Qn(z) 

V = Zi 

This feedback decomposes the system into two parts: 

• a linear subsystem of order r which is influenced by the chosen input u, 
and 

• a nonlinear subsystem described by the zero dynamics. 

This observation is stated in the theorem below. 
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Theorem 10.3.1 (Input— output linearization). Consider a nonlinear 
system having relative degree r at x°. The state feedback 



u = 



1 

LgVf'hi x) 



(—L r fh(x) + v ) 



(10.69) 



transforms this system into a system whose input-output behavior is identical 
to that of a linear system having a transfer function 

H (*) = 7 



It is important to observe that linearizing feedback of the input-output lin- 
earization determined by Equation (10.69) is easy to compute and influences 
only the r coordinates of the system. The rest, which is not influenced by the 
feedback, is determined by the zero dynamics of the system (see in Subsection 
5.5.1). Therefore, the main applicability condition of input-output lineariza- 
tion is to have a stable zero dynamics in a wide domain of the state-space, 
or even better, a globally stable zero dynamics. 



Example 10.3.1 (Input output linearization) 



Consider again the system (10.66), but now with the predefined 
output equation h{ x) = X 2 ■ It’s easy to check that L g h(x) = 1 in 
each point of the state-space and thus the system has uniformly 
relative degree 1 with respect to this output. The components of 
the feedback for the input-output linearization are 

, , —Lfh(x) 

a(x) = T \ = XlX 2 ’ P( X l = 1 

Lghfx) 

The state equations of the closed-loop system are 

X\ = —xf + X 2 

±2 = — X\X 2 + X\X 2 + V = V 



10.4 Process Systems with Maximal Relative Degree 

The following simple process example illustrates the technique of feedback 
linearization and introduces the general statements on process systems with 
maximal relative degree which follow thereafter. 
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Example 10.4.1 (Feedback linearization of a tank) 

Tank with outflow valve example 



Let us have a simple tank with output convection driven by the 
hydrostatic pressure at the bottom of the tank through a valve 
with square root characteristics. Assume that the inflow to the 
tank is the input variable. Develop the nonlinear state-space model 
of the tank and apply feedback linearization. 

The state equation of the tank is the overall mass balance over 
the tank-valve system: 

= pv B - k* \J pgh (10.70) 

where p is the density, A is the uniform cross-section, h is the 
level, Vb is the volumetric inflow, g is the gravitation constant 
and k* is the valve constant. 

The above equation can be easily rewritten in the usual state 
equation form by assuming x = h and u = Vb- 

dx 

— = — k-2\fx + k\u (10.71) 

The solution of the State-space Exact Linearization Problem is 
the following: 

• g(x) = k\ is non-zero for any x € R. because it is a constant 
function. The distribution spanjg} is involutive since it is one- 
dimensional. 

• In this case we have to deal only with the non-triviality condi- 
tion 

L g X(x°) ^ 0. It is satisfied at any point of the state-space if we 
choose A, e.g. as follows 

X(x) = x (10.72) 



since L g X(x) = k\. Note that this means that the State-space 
Exact Linearization Problem can be solved in any point of the 
state-space. 

• Thus 



- LfX(x ) _ ki\fx 

LgX(x) ki 



(10.73) 



and 



fl(x) 



1 

LgX(x) 



1 

ki 



(10.74) 
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• The linearizing transformation is given by 

z = <P{x) = col(A(a;)) = x (10.75) 

The state equation of the system after applying the linearizing 
feedback is written as 

x = —k 2 \fx + + j-v) = v (10.76) 

which is linear and controllable. 



There are several characteristic process systems which exhibit the maximal 
relative degree property r = n. In order to find them we use the notion of 
the structure graph of a lumped system. 

Definition 10.4.1 (Structure graph) 

The structure graph of a lumped nonlinear system is a directed graph G = 
( V , E) where 

• the vertex set V is partitioned into three subsets 

v=uuxuy unx = x nY =unY =0 

with U being the set of inputs, X the set of state and Y the set of output 
variables, 

• the edge set E describes direct influences between the variables, i.e. a di- 
rected edge ( Vi,Vj ) exists from to Vj if the variable Vi is present on the 
right-hand side of the equation determining Vj (in the case of output) or 
Vj (in the case of state). 

Note that there is no inward directed edges for input and no outward directed 
edges for output variables in the graph. 

Note that there is a relationship between structure matrices introduced in 
Subsection 7.4.1 and the structure graph above (see [33]). 

A necessary (but not sufficient) structural condition for a SISO system to 
have relative degree r = n is that the shortest path (or paths) from the input 
to the output should traverse all the state variables. 

The following cases with clear engineering meaning satisfy the condition 
above. 

1. Systems with only a single state variable (n = 1) 

The conditions are trivially fulfilled but it is not a practically interesting 
case (see Example 10.4.1). 
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2. Cascade systems (lumped DPS systems or a sequence of CSTRs) with a 
single balance in each lump and with special input and output 
An example of this is a sequence of isothermal CSTRs with constant 
overall mass and a simple r-th order reaction in each tank where the 
component mass balances form the set of state equations: 



dc A 

dt. 



v pb- 1 ) _ -(‘A _ u c O r 

y(j) \ C A C A I 



If we then choose u = Cjp as the inlet concentration and y = c' : ^ as the 
outlet concentration, then the structure of the input and output functions 
is given by: 





* 




' 0 ' 


g(x) = 


0 


, h T (x ) = 


0 




0 




** 



where * denotes a non-zero entry, and the system is of full relative degree. 
3. Cascade systems with more than one balance but with a special selection 
of input and output variables 

An example is a heat exchanger cell where the cold side flow rate is 
manipulated (u = v c ) and the hot side outlet temperature is chosen as 
the output variable y = Th 0 . 



10.5 Exact and Input— output Linearization of a 
Continuous Fermenter 

In this section we illustrate the use of feedback and input-output linearization 
in the example of a simple continuous fermenter described in Section 4.5.3 
following [76]. 

The nonlinear state-space model of the fermenter is given in Equations 
(4.78)-(4.79). The variables and parameters of the fermentation process 
model are collected in Table 4.1. 

A nonlinear technique, feedback linearization is applied to the nonlinear 
state-space model for changing the system dynamics into a linear one. Then, 
different linear controllers are employed in the linearized system. 

10.5.1 Exact Linearization via State Feedback 

In order to satisfy the conditions of exact linearization, first we have to find 
an artificial output function A(a;) that is a solution of the PDE: 

L g \(x) = 0 (10.77) 



i.e. 
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d\ 

dxi 



9\{x) 



d\ 

dx 2 



g 2 (x) = 0 



It’s easy to check that 



(10.78) 



t> 



V(—Sf + x 2 + So) 
xi + X 0 



(10.79) 



is a solution of (10.78) where is an arbitrary continuously differentiable 
(C 1 ) function. Let us choose the simplest possible output function, i.e. 



\{x) 



V(—Sp + x 2 + Sq) 
Xi + Xq 



(10.80) 



Then the components of state feedback u — a(x) + (3{x)v for linearizing the 
system are calculated as 



-L}X(x) 
a( x ) = T T u t 

LgLfX(x) 

P( x ) = J jK 7-T 

-Lg-Lf a(x) 

and the new coordinates are 



(10.81) 

(10.82) 



Z i=x(x) = v{ - s x :tx 0 +So) 

z 2 = LfX(x) 

g,maxV(SoXo + SoXl+X 0 X2+XlX2 — YSFSo — YSFX2 + YS^+2Yx2So + Yx2) 
Y(x 1 +X 0 ){K2x'i+2K 2 X2So+K 2 SZ+X2+So+K 1 ) 



The state-space model of the system in the new coordinates is 

Z\ = z 2 (10.83) 

i 2 = v (10.84) 

which is linear and controllable. 

The exactly linearized model may seem simple but if we have a look at 
the new coordinates we can see that they are quite complicated functions of 
x depending on both state variables. Moreover, the second new coordinate z 2 
depends on /z, which indicates that the coordinate transformation is sensitive 
with respect to uncertainties in the reaction rate expression. 

10.5.2 Input output Linearization 

Here we are looking for more simple and practically useful forms of lineariz- 
ing the input-output behavior of the system. The static nonlinear full state 
feedback for achieving this goal is calculated as 

L f h ^ | 1 .. 

Lgh(x) L g h(x) 



u = a(x) + /3(x)v 



(10.85) 
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provided that the system has relative degree 1 in the neighborhood of the 
operating point where v denotes the new reference input. As we will see, 
the key point in designing such controllers is the selection of the output (h) 
function where the original nonlinear state equation (4.78) is extended by a 
nonlinear output equation y = h(x) where y is the output variable. 

Controlling the Biomass Concentration. In this case 

h(x) = X = x\ 



and 



y(x) = - 



Lfh(x) _ VHmaxjx 2 + Sp) 

L g h(x) K 2 ^X 2 + S 0 ) 2 + X 2 + So + Ki 



-Fp 



(3{x) = -- 



V 



Xi + A'o 

The outer loop for stabilizing the system is the following: 



= —k ■ h(x ) 



(10.86) 

(10.87) 



( 10 . 88 ) 



It was found that the stabilizing region of this controller is quite wide but 
not global. The time derivative of the Lyapunov function is shown in Figure 
10 . 1 . 

Controlling the Substrate Concentration. In this case, the chosen out- 
put is 

h(x) = S = x 2 

The full state feedback is composed of the functions 



a(x) 



Vjx max ( X 2 + SoXaq + Ap) 

Y(K 2 {x 2 + S 0 ) 2 + x 2 + S 0 + K± )(S F - x 2 - So) 



+ F 0 (10.89) 



/3{x) 



V 

Sf — X2 — So 



(10.90) 



In the outer loop, a negative feedback with gain k = 0.5 was applied, i.e. 
v = —0.5x2- The time derivative of the Lyapunov function of the closed-loop 
system as a function of X and S is shown in Figure 10.2. 

Note that for this case it was proven (see the zero dynamics analysis of the 
continuous fermenter in Subsection 5.5.2) that the closed-loop system is glob- 
ally stable except for the singular points, where the biomass concentration is 



zero. 
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Figure 10.1. Time derivative of the Lyapunov function as a function of centered 
state variables q\ = 1, q 2 = 1, linearizing the biomass concentration, k = 0.5 



Controlling the Linear Combination of the Biomass and the Sub- 
strate Concentrations. In this case, the output of the system was chosen 
as 



h(x) = Kx (10.91) 

where the row vector K is calculated as the result of the previously described 
LQR cheap control design problem in Subsection 9.5.2. Then the functions 
a and (3 are given as 

a{x) = ~^M (10 - 92) 

Kg{x) 

(10.93) 

[—0.6549 0.5899] T and in the outer loop a negative 
= 0.5 was applied. The time derivative of the Lyapunov 
loop system is shown in Figure 10.3. 



(3{x) = 



1 



Kg{x) 

The value of K was 
feedback with gain k = 
function of the closed- 
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Figure 10.2. Time derivative of the Lyapunov function as a function of centered 
state variables q\ = 1 , qi = 1 . linearizing the substrate concentration, k = 0.5 



10.6 Output Selection for Feedback Linearization 

The problem of output selection for nonlinear output feedback is a general 
issue for all nonlinear systems (see, e.g. [81]). In several cases, an unstable 
nonlinear system can be stabilized by appropriate controls provided that a 
proper output is selected. 

In Section 10.2 it was shown that exact linearization has two main disad- 
vantages: first, partial differential equations have to be solved to calculate the 
output function h, and second, if we manage to find an appropriate output 
then it is (together with the coordinates transformation often a highly 
nonlinear function of the state variables, which is hard to treat practically. 
Therefore, it is of interest to select a linear output with advantageous prop- 
erties from an engineering point of view. 

In Section 5.5.2 we managed to show that controlling the substrate con- 
centration is enough for the global stabilization of continuous fermentation 
processes (i.e. we were able to select an output with globally asymptotically 
stable zero dynamics). However, the analytical investigation of the stability 
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Figure 10.3. Time derivative of the Lyapunov function as a function of centered 
state variables qi = 1, q 2 = 1, linearizing the linear combination of the biomass and 
substrate concentrations, K = [—0.6549 0.5899] T , k = 0.5 



of the zero dynamics is usually not possible in the higher dimensional cases. 
Nevertheless, using the well-known results of optimal control and the theory 
of nonlinear systems, a generally applicable linear output selection method 
can be derived. 

To establish a relation between linear systems and the zero dynamics 
of nonlinear systems, let us consider a single-input linear system given in 
standard state-space form: 

x = Ax + Bu (10.94) 

where x £ R", u £ R, A and B are real matrices of appropriate dimensions. 
Let us assume that all state variables are measurable. Furthermore, assume 
that the pair ( A , B) is controllable. 

Consider a full state feedback u = —Kx (possibly resulting from a linear 
controller design method, e.g. pole-placement or LQ-design) that asymptot- 
ically stabilizes the system (10.94). 
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The controlled closed-loop system can be interpreted in such a way that 
the system (10.94) with the output equation 

y = Kx (10.95) 

is fed back with output feedback u = —y. Therefore the system (10.94) with 
the special linear output equation (10.95) can be a minimum-phase system 
(i.e. the real parts of the zeros of its transfer function are strictly negative). 
In the linear case, the zero dynamics is a linear dynamics with eigenvalues 
coinciding with the zeros of the transfer function of the system (see, e.g. [37]). 
It is also true that the linear approximation at the equilibrium point of the 
zero dynamics of a system (3.19) is the same as the zero dynamics of the 
linear approximation of the system at the equilibrium point (see Chapter 4 
in [37]). These facts allow us to search for linear outputs based on the locally 
linearized system. 

The resulting feedback gain vector Klq of an LQ-design problem (see 
Section 9.3) is generally a good candidate for linear output selection, since the 
advantageous phase and gain margins of the LQ-loop are well-known (see, e.g. 
[22] or [48]). In particular, the infinite gain margin guarantees that the system 
(10.94) with output Klq will be locally minimum-phase. The explanation of 
this fact is the following: it is well-known from classical root-locus analysis 
that as the feedback gain increases towards infinity, the closed-loop poles 
migrate to the positions of open-loop zeros [64] . Thus the infinite-gain margin 
in the linear case means that the closed-loop system remains stable if we 
increase the loop-gain. It also means that the linear system (10.94) together 
with the output equation 

y = K LQ ■ X (10.96) 

has stable zeros (i.e. asymptotically stable zero dynamics). 

By applying the above-mentioned relation between the zero dynamics of 
the locally linearized system and the locally linearized zero dynamics of the 
original nonlinear system, we obtain that the original nonlinear model with 
the same linear output (10.96) will have at least locally asymptotically stable 
zero dynamics. Note that this property is not necessarily true in the case 
of the output generated by any locally stabilizing linear controller, but it 
is always fulfilled by the feedback gain of LQ-controllers. In summary, the 
method has two main advantages: 

• it can be applied directly to lrigh-dimensional nonlinear systems without 
complicated calculations, 

• the closed-loop performance can be evaluated and set easily because the 
output is linear. 

Output Selection for the Continuous Fermenter. Now, let us check the 
minimum-phase property of the linearized system for continuous fermentation 
processes. Consider the linearized model in Equations (4.84)-(4.87) together 
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with the output equation in Equation (10.96), where we examine two feedback 
gains in Subsection 9.5.2, namely: 

1. K LQl = [-0.6549 0.5899] 

2. K L q 2 = [-1.5635 2.5571] 

where the LQ-controller design parameters were Q = I 2x2 , R = 1 and Q = 
10 • I 2x2 , R = 1 respectively. 

The zeros of the corresponding transfer functions are: 

1. z\ = —0.6590 and 

2. 22 = -0.7083 

which are stable. Thus both of the outputs generated by Equation (10.96) 
can be applied to feedback linearization of the continuous fermenter. 



10.7 Further Reading 

The use of the normal form (5.53) was first proposed in [36]. The state-space 
exact linearization problem was proposed and solved in [15] for single-input 
systems and [38] for multi-input systems. The notion of zero dynamics is from 
[17] and it was used for stabilization in [18]. 



10.8 Summary 

Feedback linearization techniques, namely exact linearization and input- 
output linearization have been introduced in this chapter together with the 
related basic notion of relative degree. The existence of the solution and the 
applicability conditions of both the exact and input-output linearization have 
also been described and analyzed. 

Engineering conditions of process systems that are of maximal relative 
degree have also been discussed. The linearization techniques have been il- 
lustrated in a case study of a simple continuous fermenter. Finally, a practical 
way of output selection for feedback linearization has also been proposed. 



10.9 Questions and Application Exercises 

Exercise 10.9.1. Compare the exact linearization and input-output lin- 
earization techniques for input-affine nonlinear systems. Comment on their 
applicability conditions and their need for computational resources. 

Exercise 10.9.2. Give engineering conditions for a process system to have 
maximal relative degree. 




250 10. Feedback and Input-output Linearization of Nonlinear Systems 



Exercise 10.9.3. Compute the relative degree of the input-affine nonlinear 
state-space model of the simple fed-batch fermenter developed in Subsection 
4.5.2 and given in Equations (4.71)-(4.74) with the output equation and input 
variable: 

y = x i = X, u = Sf 

Exercise 10.9.4. Consider the bilinear (nonlinear) input-affine state-space 
model of the heat exchanger cell developed in Section 4.4.4 with the input 
and output variables 

u = v c , y = T h = x 2 

Check the applicability conditions and then perform exact linearization of 
the system. 

Exercise 10.9.5. Consider the bilinear (nonlinear) input-affine state-space 
model of the heat exchanger cell developed in Section 4.4.4 with the input 
and output variables 

u = v c , y = T c = x i 

Check the applicability conditions and then perform input-output lineariza- 
tion of the system. 

Exercise 10.9.6. Consider a simple CSTR model developed in Subsection 
4.5.1 with the input and output variables 



^ — CAim V — CA 

Compute the relative degree of the system and apply exact linearization if it 
is possible. 

Exercise 10.9.7. Consider the following two-dimensional nonlinear system 
model (the same as in Exercise 6.9.4) in its input-affine state-space form: 

dx l 1/2 3/2 3 . 1/2 

-^- = aq aq — X1X2 + aq u 1 

= 3xix^ 2 — 2 x\x 2 

y = xl 

Compute the relative degree of the system and apply exact linearization if it 
is possible. 

Exercise 10.9.8. Consider again the above two-dimensional nonlinear sys- 
tem model (the same as in Exercise 6.9.4) but with another output in its 
input-affine state-space form: 

dx \ 1/2 3/2 3 1/2 

-jj- = x 1 X2 — x\x 2 + aq u± 

= ZxixlJ 2 — 2a:ia;2 

y = xi 
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Check the applicability conditions and then design an input-output lineariz- 
ing feedback to the above system. 
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A conceptually simple but yet powerful way of obtaining a passive system 
from a non-passive one is to apply a nonlinear static feedback to make it 
passive. This idea is the basis of passivation by feedback, which is the subject 
of this chapter. 

The material is presented in the following sections: 

• The passivation problem and static feedback design 

Here we describe the necessary and sufficient conditions that enable us to 
construct a static feedback which makes a nonlinear input-affine system 
passive. 

• Stabilization using control Lyapunov functions 

A special case of stabilizing static feedback design is when a suitable chosen 
Lyapunov function is prescribed for the closed-loop system. This practically 
important controller design method is the subject of this section. 

• Direct passivation of a continuous fermenter 

This simple case study illustrates the notions and tools of direct passivation 
by feedback. 

• Direct passivation of a gas turbine 

This section presents a more detailed case study of practical importance 
where the controller based on passivation is the key element of control 
system design. 



11.1 The Passivation Problem and Static Feedback 
Design 

In this section, we examine the conditions of transforming an input-affine non- 
passive system by static nonlinear feedback of the form (9.3), into a system 
which is passive with respect to the new input and the system’s output. The 
material covered in the section is based on [19] and [80]. 

Consider the input-affine state-space model (3.19) in the form of 

. x(t) = f(x(t)) + gi(x(t))ui(t) 
y(t ) = h(x(t)) 
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and let us denote it simply by E. With the static state feedback with external 
input as defined in Definition 9.1.2 in the form 

u = a(x ) + (3(x)v 



the closed-loop system denoted by £ a ,p is given by 



x= [f(x) + g(x)a(x)] + g(x)(3(x)v 
a ' p ■ y = h(x ) 


(11.1) 


Definition 11.1.1 (Feedback equivalence) 

E is said to be feedback-equivalent to E a ^p in Equation (11.1). 


Now, we present the main line of the solution without going too much into 
the details. First, suppose that we have achieved our goal, i.e. that £ a ,p is 
passive with a storage function S > 0. Then 


rti 

S(x(ti)) - S(x(t 0 )) < / v T (t)y(t)dt, Vti > < 0 
Jtn 


(11.2) 


Now, examine the behavior of the closed-loop system when its output is 
identically zero: 


™ . X = [f(x) + g(x)a(x)] + g(x)l 3(x)v 

a >0 ‘ 0 = h(x) 


(11.3) 


Then it is easy to see from (11.2) that 




S^fi)) - S(x(t 0 )) < 0, Vfi > t 0 


(11.4) 


which means that the zero dynamics of the closed-loop 
Let us now return to the original open-loop system 
straint y = 0 


system is stable. 
system with the con- 


yc . x = f(x) + g(x)u 
0 = h(x) 


(11.5) 


and assume that (x (t),u(t)) is a solution of E c . Then, 
the feedback law, it is clear that 


by expressing v from 


x(t), v(t) = P^ 1 (x(t))(u(t) — a(x(t))) 


(11.6) 


is a solution of E c a p, and (11.4) holds in this case, too. This way, we have 
concluded that the stability of the zero dynamics is a necessary condition of 
passivation. 

Now, let us calculate the input which is necessary to keep the system’s 
output at 0. If we consider the condition y = 0, then naturally y = 0 and we 
can write 


y = h x (x)f(x) + h x (x)g(x)u 


(11.7) 



This gives the condition below for u as the stabilizing (or passivating) input. 
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Definition 11.1.2 (Passivating feedback) 

The static state feedback of the form 

u*(x) = -[. h x (x)g(x)]~ 1 h x (x)f(x ) (11.8) 

is called the passivating feedback. Note that h x (x)g(x) must be of fid l rank in 
a neighborhood of 0 in order to calculate the inverse in (11.8). 

Of course, the initial condition of the system must be in the set 
X c = {xe X\h(x) = 0}. 

To summarize the above, let us state the following theorem: 

Theorem 11.1.1 (Necessary condition of passivation). Suppose S is 
feedback-equivalent, to a passive system with a C 2 storage function S locally 
about x = 0, for which S'(O) = 0 and S(x) >0, x ^ 0. Assume that h x (x)g[x) 
has rank m in a neighborhood of 0. Then 

S x (x)[f(x) + g(x)u*(x)] < 0, x G X c (11.9) 

with u*(x) defined by (11.8). 

The following sufficient condition is very similar to the previous one. 

Theorem 11.1.2 (Sufficient condition for passivation). Consider the 
system S. Suppose rank(/ia;(0)<7(0)) = m, and let S > 0 be such that S( 0) = 0, 
S(x) >0, x ^ 0 and satisfies S x (x)[f( x) + g(x)u*(x)] < 0, x £ X c . Then 
E is locally feedback-equivalent, to a passive system with a storage function 
which is positive definite at. x = 0. 

The complete proof can be found in [80] . The idea of the proof is to describe 
the system as a standard feedback interconnection of two passive systems 
using local coordinates transformations. 



11.2 Stabilization Using Control Lyapunov Functions 

In this section we investigate the possibilities of stabilizing a nonlinear system 
using a pre-defined Lyapunov function. Consider an input-affine nonlinear 
system (3.19) and the set of static feedbacks (without new input) introduced 
in Definition 9.1.1. Assume that the system is stabilized by a smooth feed- 
back u = a(x). Then, according to the converse Lyapunov theorem (see in 
Theorem 7.3.2), there exists a proper Lyapunov function V : X i— > R+, which 
is decreasing along the closed-loop system’s trajectories, i.e. 

~tlt V = + g( x ) a ( x )) = LfV(x) + a(x)L g V(x) < 0 (11.10) 

It is visible from (11.10) that if L g V(x) is identically set to zero, then neces- 
sarily LfV(x ) < 0. 

Motivated by this, let us define a special function that can be the Lya- 
punov function of the closed- loop system. 
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Definition 11.2.1 (Control Lyapunov function) 

A control Lyapunov function of the system (3.19) is a proper function 
V : X >— > K + with the property 

L g V{ x)=0 => LfV (x) < 0, VzyfO (11-11) 

The importance of control Lyapunov functions is that the existence of such 
a function is also a sufficient condition for a stabilizing feedback law, as is 
stated by the following theorem: 

Theorem 11.2.1 (Artstein-Sontag’s theorem). Consider a nonlinear 
input-affine system of the form (3.19) where f and g are smooth vector fields 
and /( 0) = 0. There exists a feedback law u = a{x) which is smooth on 
K™\{0}, continuous at x = 0 and globally asymptotically stabilizes the equi- 
librium x = 0 if and only if there exists a function V : X i— > K+ with the 
following properties: 

1. V is a control Lyapunov function for the system (3.19). 

2. When Ve > 0 there exists 6 > 0 such that for ||a;|| < S, x yf 0 there is 
some u, |w| < e such that 

LfV{x) + L g V ( x)u < 0 

Property 2 is required for the continuity of the feedback law at 0. 

The proof of this theorem is constructive (it can be found, e.g. in [37]) and 
gives a possible stabilizing feedback law based on control Lyapunov functions 
in the following form: 



( 0 if L g V(x) = 0 

“ W = { - fEh EME otherwise 



( 11 - 12 ) 



Quadratic Lyapunov functions are popular and powerful Lyapunov func- 
tion candidates when analyzing stability of nonlinear systems. The notion of 
quadratically stabilizable systems given by Definition 7.3.2 reflects this fact 
such that a special class of nonlinear systems is formed which enables us to 
have a quadratic Lyapunov function. 

The following example illustrates how to construct a quadratic Lyapunov 
function for a simple nonlinear system: 
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Example 11.2.1 (Quadratic control Lyapunov function) 



The aim in this example is to find a control Lyapunov function 
for the following input-affine system: 



Xi 




2xi + x 2 + x 3 




' 1 ' 


X 2 


= 


x 3 x 2 - 2x 2 


+ 


0 


X 3 _ 




x\x 3 




0 



(11.13) 



We seek the control Lyapunov function V in the following simple 
form: 

V{x) = ^{qixl + q 2 x \ + q 3 xl) 

where qi,q 2 and q 3 are positive real parameters. 

The gradient of V is then 



V x (x) = [qiX\ q 2 x 2 qzx 3 



The condition L g V(x) = 0 now specializes to <712:1 = 0, which is 
equivalent to X\ = 0. 

Now, we calculate the sign of the derivative of the candidate Lya- 
punov function along the system trajectories restricted to x\ = 0. 



LfV{ x) = [qixi q 2 x 2 q 3 x 3 



2x\ + x\ + x 3 
x\x 2 — 2 x 2 
x\x 3 



= qiXi(2xi + x 2 + x 3 ) + q 2 x 2 (xix 2 - 2x 2 ) + q 3 x 3 (x\x 3 ) 



-2q 2 xl 



It is clear from the above that V is a control Lyapunov function 
of the system for any qi,q 2 ,q 3 > 0. 



11.3 Control Lyapunov Function of a Continuous 
Fermenter 

In this section we investigate a simple quadratic Lyapunov function, i.e. 
whether it can be the control Lyapunov function of the continuous fermen- 
tation process described in Subsection 4.5.3. The results of the forthcoming 
calculations are based on the parameter values listed in Subsection 4.5.2 and 
the operating point is the optimal one calculated in Subsection 4.5.3. We will 
use the centered version of the state equations with / and g in (4.79) with 
the following notations: 
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®i = X, x 2 = S, xl = Xo, x* 2 = So , u* = F 0 

Let the control Lyapunov function candidate be given in the following simple 
form: 

V c (x) = ^(qixl + q 2 x%), qi,q 2 >0 (H-14) 

It’s easy to see that the set L g V c o := {x € K 2 | L g V c (x) = 0} is an ellipse in 
the state-space, since 

L g V c {x) = -^{qix\ + qiXxx\ + q 2 x 2 {x 2 - S F ) + 92 * 2 ) (11.15) 

Let us choose q\ == 1 and q 2 = 1 in (11.14). Then (11.15) defines a circle in the 
state-space as is shown in Figure 11.1. To check the sign of the derivative of 




Figure 11.1. The set {i£l 2 | L g V c (x) = 0} for q\ = 1 and q 2 = 1. 



the control Lyapunov function candidate, we first express the x\ coordinate 
as a function of x 2 from L g V c (x) = 0, i.e. we try to solve this equation for 
X\. The solutions are 



1 , 2 ) _ —x* ± \J (xj) 2 — 4X2^2 + 4x 2 Sf — 4x 



x\-'-' = 



(11.16) 



which define the upper and lower halves of the circle in Figure 11.1. Let us 
first check the derivative of the control Lyapunov function candidate along 
/. For this, first calculate LfV, which reads 

(xi + x\)u 
~V 



L f V c (x) = xi fi(x) + x 2 f 2 (x) = xi yi(x 2 + x 2 )(xi + x\) - 
n{x 2 + x 2 )(xi + x\) (S F — x 2 — x 2 )u* 



+X 2 - 



Y 



V 



(11.17) 




11.4 Case Study: Direct Passivation of a Gas Turbine 



259 



Now check the sign of LfV c first in the upper half-circle by substituting 
into (11.17); we then get a function with only one independent variable ( X 2 )• 
Instead of algebraic derivation (in fact, this will be the reader’s exercise at 
the end of the chapter), we only give the graph of this function in Figure 11.2. 
It is visible that the sign of the Lie-derivative is negative in a neighborhood 
of X 2 for X 2 ^ 0. (It can be shown that the function is negative on the whole 
half-circle for 12 / 0. ) 




Figure 11.2. The derivative of the control Lyapunov candidate along / restricted 
to the upper half-circle 



Next let us examine the sign of LfV c in the lower half-circle. For this, we 
substitute x\ into (11.17). Similarly to the previous case, we only present the 
graph of the obtained function to illustrate the solution in Figure 11.3. As is 
visible for X 2 > 0, the sign of the function is positive, but this region would 
correspond to an operating region where X < 0 (see also Figure 11.1 again), 
which is practically not meaningful. Furthermore, it can be shown that the 
sign of LfV c is again negative in the lower half-circle if A >0. 

Finally, we can conclude that the proposed simple quadratic candidate V c 
with qi = q 2 = 1 is a control Lyapunov function of the continuous bio-reactor 
model in the physically meaningful operating region. Now, it is possible to 
apply Theorem 11.2.1 to design a stabilizing feedback of the form (11.2). 

11.4 Case Study: Direct Passivation of a Gas Turbine 

As a case study, a simple nonlinear controller for a low-power gas turbine 
based on direct passivation is introduced here [3]. It uses a nonlinear state- 
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Figure 11.3. The derivative of the control Lyapunov candidate along / restricted 
to the lower-half circle 



space model of the gas turbine in input-affine form based on first engineering 
principles, which is described in Section 4.6. 

The proposed nonlinear controller is based on a prescribed quadratic con- 
trol Lyapunov function and is able to solve the protection of the gas turbine. 
The robustness of the closed-loop system with respect to the time-varying 
parameters is also investigated. 



11.4.1 Nonlinear State-space Model 

The nonlinear state-space model in its input-affine form can be developed 
from the model equations based on first engineering principles. For the gas 
turbine we use the intensive form of the model equations (4.93), (4.98), (4.99), 
(4.100) and (4.101) described in Section 4.6.5 with the constitutive equations 
in Section 4.6.6. 

System Variables. The state variables of the gas turbine model are then 
as follows: 

x = [ mcomb P 3 n } T (11.18) 

The value of the only input variable Vf U ei is also constrained by: 
0.003669480223 < v fue i < 0.02701065149 [kg/sec] 

The set of possible disturbances includes: 
d=[pi Ti Mi oad } T 



(11.19) 
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It is important to observe that the state and disturbance variables can only 
vary within a prescribed operating region described in Section 4.6.7. 

Finally we construct the set of measurable output variables: 

y=[T 4 p 3 n } T (11.20) 



Model Equations. The dynamic equations with these vectors can be trans- 
formed into input-affine form: 



-=f( X ) + g( X ) U (11.21) 

y = h(x) (11.22) 

with the following /, g and h functions: 



f(x) 



fi{xi,x 2 ,x 3 ,d 1 ,d 2 ) 
f 2 {xi,x 2 ,x 3 ,d!,d 2 ) 
f 3 (xi,x 2 ,x 3 ,di,d 2 ,d 3 ) 



(11.23) 



9{x) 



const 

const 

0 



h(x) 



hi(xi,x 2 , x 3 , e?i) 
x 2 
x 3 



(11.24) 



(11.25) 



It is important to note that these functions do not depend on only the state 
variables, but also on the disturbance vector. Further, observe that g( x) does 
not depend on the state vector x. This means that the effect of the input is 
linear to the time derivative of the state vector. 



Open-loop Properties of the System. It is found by standard nonlinear 
analysis ([37]) that the developed model is reachable and observable in the 
whole application domain and stable in a small neighborhood of any admis- 
sible operating point ([2]). Therefore the asymptotic stability of all operating 
points can be guaranteed in the whole application domain. 

The measurable time-varying parameters of the system are collected into 
the disturbance vector. All elements of this vector are correctly measurable 
and significantly change their values during the operation of the gas turbine. 

There are also some unmeasurable time-varying parameters in the non- 
linear model. The value of the parameters ay, a comb, cn and ycomb are not 
constant, but they change their values only about ±2 percent. 

Because of these properties, we have to achieve disturbance-rejection and 
robustness of the closed- loop system as stated in the control aims before. 
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11.4.2 Controller Design 

Control Aims. The following control aims is set for our low-power gas 
turbine: 

• The number of revolutions has to follow the position of the throttle and 
should not be affected by the load and the ambient circumstances (the 
disturbance vector). 

• The temperatures (basically the total temperature after the turbine) and 
the number of revolutions has to be limited, their values are constrained 
from above by their maximum values. 

Protection of the Gas Turbine. The aim of the protection of the gas 
turbine is twofold: to avoid too-higlr temperatures and too-lrigh numbers of 
revolutions. 

1. The turbine outlet temperature y\ has a maximum value of 938.15 K. 
If the setpoint for yi is higher than its maximum value, then we can 
increase the number of revolutions (the temperature will then decrease), 
but the number of revolutions also has a maximum value: 833.33 sec -1 . 

2. If the position of the throttle specifies a higher value for the number of 
revolutions X 3 than its maximum, then we do not allow it; the value will 
be its maximum. 

Static Nonlinear Stabilizing Controller. In the first step, a static non- 
linear full state feedback is designed to stabilize the system in the whole 
operating region. For this, let us assume that the point xo is an equilibrium 
point for the system (i.e. /( x 0 ) = 0) and define a positive definite storage 
function 

V(x) = (x — xq) t M{x — a’o) (11.26) 

where M is an n x n positive definite symmetric matrix. If we set the input 
u as 



U = Vp + V + w 


(11.27) 


where 




_ L f V(x) 
L g V(x) 


(11.28) 


and 




v = —k ■ L g V(x), k > 0 


(11.29) 



then the closed-loop system will be passive with respect to the supply rate 
s = w T y with storage function V where y = L g V(x) and w is the new 
reference input ([19]). Note that the feedback law in Equation (11.28) has 
singular points where L g V(x) = 0, therefore Xo has to be selected carefully to 
be outside the real operating region. The new reference input w is calculated 
from the linear shift between Xq and the setpoint. 
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Achieving Robustness with a Pi-Controller. In order to remove the 
steady-state error in the number of revolutions caused by the change of the 
unmeasurable time-varying parameters, a Pi-controller (which is itself again 
a passive system) is applied in the outer loop, i.e. 

' w(t ) = k p (y 3s - y 3 (t)) + ki ■ f ( y 3s - y 3 (r))dT (11.30) 

Jt o 

where y 3s is the constant setpoint for the number of revolutions, y 3 (t) is the 
number of revolutions as a function of time, k p and ki are the parameters of 
the Pi-controller. 

11.4.3 Simulation Results 

For the simulations a typical operating point has been selected: 



[ 0.00580436 197250.6068 700 } T 


(11.31) 


[ 101325 288.15 10 } T 


(11.32) 


0.009252624089 


(11.33) 



Simulation of the Open-loop System. The properties of the open-loop 
system are well demonstrated by the simulation results. Figure 11.4 shows a 
case where the number of revolutions has been changed to 400 and the system 
is not able to reach the setpoint, indicating that the open-loop system is not 
globally asymptotically stable. Figure 11.5 shows that the open-loop system 
is sensitive with respect to the change of the disturbances: if we change the 
Mioad, from 10 to 30 then the engine shuts down. 

Simulation of the Closed-loop System. In order to achieve appropriate 
dynamics of the closed-loop system, we have to tune M to be positive definite 
and symmetric; to select the positive constant k and the parameters of the 
Pi-controller ki and k p . The tuning of these parameters was carried out by a 
trial and error method and the following values were obtained: 

'10 0 0 ' 

M = 0 1000 0 (11.34) 

0 0 0.001 

and k = 0.0005, ki = 0.7, k p = 1.1. 

Figure 11.6 shows the same case as in Figure 11.4 with our nonlinear con- 
troller. It indicates that the controller indeed stabilizes the system globally. 
Figure 11.7 shows that the closed-loop system is not sensitive to the elements 
of the disturbance vector. If we increase the load, the number of revolutions 
decreases, but the nonlinear controller is able to set the original operating 
point. 

Figure 11.8 shows a setpoint change and the robustness of the controller. 
The position of the throttle has been changed from 700 sec -1 to 750 sec” 1 
and simultaneously one time- varying parameter has been raised by 2 percent. 
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Figure 11.4. Response of the number of revolutions of the open-loop system (un- 
stable) 




Figure 11.5. Response of the number of revolutions of the open-loop system (sen- 
sitive) 



Conclusion. The nonlinear controller described above for a low-power gas 
turbine is able to guarantee the asymptotic stability of the closed-loop system 
in every operating point of the application domain. 

This controller keeps the number of revolutions in accordance with the 
position of the throttle while the number of revolutions is not affected by the 
load and ambient circumstances. 

At the same, time the controller can protect the gas turbine against a 
too-high temperature and too-higlr number of revolutions at a setpoint and 
the closed-loop system is robust with respect to the time- varying parameters. 
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Figure 11.6. Response of the number of revolutions of the closed-loop system 
(stable) 




Figure 11.7. Response of the number of revolutions of the closed-loop system (not 
sensitive) 



11.5 Further Reading 

The conditions for making a system passive through static nonlinear feed- 
back were derived in [19]. Control Lyapunov functions are described in a 
rigorous and detailed way in, e.g. [68]. The Artstein-Sontag’s Theorem for 
the stabilization of nonlinear system was presented in [67]. 

Mechatronic systems, such as robots, are the traditional area of passivat- 
ing control, see, e.g. [61] for a recent reference. 

Process Systems. The idea of controlling process systems based on ther- 
modynamical principles was introduced in the 1990’s [55], [84], [23]. Ydstie 
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Figure 11.8. Response of the number of revolutions of the closed-loop system 
(set-point change) 



[83] offers a recent survey on passivity-based control of process systems via 
the second law. 

Passivity-based control of nonlinear chemical processes has recently been 
reported in [63]. The approach has been extended to distributed (i.e. infinite 
dimensional) process systems in [4] and [5], too. 



11.6 Summary 

The methods for designing static feedback laws that stabilize (or passivate) 
a nonlinear system are described in this chapter. The practically impor- 
tant method of stabilizing state feedback design uses a prescribed, usually 
quadratic control Lyapunov function. 

Two case studies that illustrate the design and usefulness of stabilizing 
feedback controllers are presented. The direct passivation of a simple con- 
tinuous fermenter proposes a controller structure which stabilizes the system 
globally. The passivation of a gas turbine represents a practically relevant 
case, where the key element of the controller is the stabilizing loop. 



11.7 Questions and Application Exercises 

Exercise 11.7.1. Give the design parameters of the passivating and stabi- 
lizing controller design. Comment on the effect of these parameters on the 
properties of the closed-loop system. 
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Exercise 11.7.2. Give the design parameters of the passivating and stabi- 
lizing feedback controller design. Comment on the effect of these parameters 
on the properties of the closed-loop system. 

Exercise 11.7.3. Compare the design and properties of the passivating and 
stabilizing feedback controllers. Comment on the applicability conditions, 
the information and model they require and on the computational effort they 
need. 



Exercise 11.7.4. Consider the use of the LTI state-space model of the free 
mass convection network in Equation (4.22) developed in Subsection 4.2.4. 
Design a passivating and a stabilizing feedback controller for this simple 
process system. 

Exercise 11.7.5. Consider the LTI state-space model of the heat exchanger 
cell developed in Subsection 4.4.2 of Section 4.4. Design a passivating and a 
stabilizing feedback controller for this simple process system. 

Exercise 11.7.6. Consider a simple CSTR model developed in Subsection 
4.5.1. Construct a passivating feedback controller for to this system. 

Exercise 11.7.7. Consider again a simple CSTR model developed in Sub- 
section 4.5.1. Construct a stabilizing feedback controller for this system using 
a quadratic control Lyapunov function. 

Compare the controller with the passivating feedback one designed in 
Exercise 11.7.6. 



Exercise 11.7.8. Consider the bilinear (nonlinear) input-affine state-space 
model of the heat exchanger cell developed in Subsection 4.4.4 with the input 
and output variables 

u := v c , y = T h = x 2 

Construct a stabilizing feedback controller for this system using a quadratic 
control Lyapunov function. 



Exercise 11.7.9. Consider the following two-dimensional nonlinear system 
model (the same as in Exercise 6.9.4) but with another output in its input- 
affine state-space form: 

dx\ 
dt 
dx 2 



_ 1/2 3/2 



X\x\ 



1/2 



U 1 



= 3XlX^/ 2 — 2 x\x 2 
y = x 1 



Check the applicability conditions and then design a stabilizing feedback 
controller for the system. 
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This chapter deals with stabilizing control and loop-shaping of Hamiltonian 
systems. The basic notions and tools of the Hamiltonian system models to- 
gether with process examples were given in Chapter 8. 

In the first part of the chapter we follow [21]. Thereafter the methods and 
results are extended to process systems. 

The following sections contain the material of the chapter: 

• Stabilization of Hamiltonian systems 

The stabilization is done in two logical steps: stable systems are made 
asymptotically stable by adding damping to the systems while unstable 
systems are made stable by shaping their potential energy. This leads to a 
nonlinear proportional-derivative (PD) output feedback controller. 

• Stabilization and loop-shaping of nonlinear process systems 

Using the specialities of the Hamiltonian system model of process systems, 
the above tools and techniques are then applied to process systems. 

• Simple process examples 

A heat exchanger cell model and the model of the free mass convection net- 
work are used to illustrate the design of the nonlinear PD output feedback 
controller. 

• Stabilization of a simple unstable CSTR 

Besides the stabilizing property of the nonlinear PD output feedback con- 
troller, the design parameters and the stability region of the controlled 
system are also investigated in the example of a simple unstable CSTR. 

• Hamiltonian control of a simple continuous fermenter 

In this section, a complete case study is presented where various nonlinear 
PD output feedback controller structures are applied to the system, and 
their performance is compared. 



12.1 Stabilization of Hamiltonian Systems 

Let us consider a simple Hamiltonian system (see Definition 8.4.1 in Subsec- 
tion 8.4.2) with an equilibrium point : 



x o = (Qo,Po) 
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It immediately follows from 



._dH 0 
q dp 



G{q)p 



that po = 0. Furthermore qp satisfies grad V(qp) = 0, because it is an equi- 
librium point. 



12.1.1 Asymptotic Stabilization of BIBO-stable Systems 



First, we show that an equilibrium point of a simple Hamiltonian system can 
be stable without being asymptotically stable. 

Lemma 12.1.1. Let (<7o,0) be an equilibrium point of the simple Hamilto- 
nian system given by Equations (8.32)-(8.33) . Suppose that V(q) — V(qp) is 
a positive definite function in some neighborhood of qo . Then the system for 
u = 0 is stable but not asymptotically stable. 



Proof. We will show that 

C(q,p) = H 0 (q,p ) - V(q 0 ) = ^p T G(q)p + V(q) -V(q 0 ) 



is a Lyapunov function for a system with u = 0. Indeed, 



d_ 

dt 



£(q,p) 




(<lp) 




dH 0 8H 0 
dqi dpt 



dH 0 dH 0 \ 

dpi dqi ) 



( q,P ) = 0 



( 12 . 1 ) 



Note that we have used the definitions and the state-space model form in 
Equations (8.29)-(8.31) to derive the above result. 

Furthermore, since G(q) > 0 and by assumption V(q) — V(qp) is positive 
definite, it follows that C(p,q) is positive in some neighborhood of (go>0)- 
Since by Equation (12.1) jjC(q,p) = 0, it also follows that (qp,0) cannot be 
an asymptotically stable equilibrium. 



Derivative Output Feedback. We can improve the situation, that is, to 
make this stable equilibrium point asymptotically stable by introducing a 
derivative output feedback to every input-output pair as follows: 



dHi . 

Ui = -yi = -—r~, i = l,...,m 
dt 



(12.2) 



which physically means adding damping to the system. 

Indeed, with this feedback we obtain (again using Equations (8.29)-(8.31) 
with (12.1) and (12.2)): 
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dHn . dHn 



y, dH 0 dH 0 dH 0 dH 0 dH :j 

~ E \ ~d^^ ~ Wi l &zT + E ~W Uj 



= EE 



t=i j=i 



which finally yields 

y£(<7,p) = ^-H 0 (q,p) = - ^T yi 2 < 0 



12.1.2 Stabilization by Shaping the Potential Energy 

The main assumption in Lemma 12.1.1 was the positive definiteness of the 
difference V(q) — P(go) near an equilibrium point q$. If this assumption does 
not hold, then let us apply a linear proportional static output feedback 

Ui = -kiyi + Vi, i = 1, . . . ,m (12-4) 

with v t being the new control inputs to the simple Hamiltonian system (8.32)- 
(8.33). 

The Closed-loop Hamiltonian System. The resulting system is again a 
simple Hamiltonian system. In order to show this, we substitute the feedback 
(12.4) into the defining equations to obtain: 

. mm 

H{q,p,v) = -p T G{q)p+ V(q) + Y H j(l) k i -J2 H j(q)vj 

1=1 1=1 

with the internal Hamiltonian 

H 0 (q,p) = 7 ^P T G(q)p+V(q) (12.5) 

where V ( q ) is the new potential energy 



V(q) = V (q) + Y k iVi 



and with the state-space model: 

OH 0 , . . 

Qi = — (q,P), i = l,...,n 

&Pi 

dH 0 , , , ^ dH :j , ^ . i 

= + t = 1 > 



Vj = H j(q )> 3 = !,•••)’ 
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Equation (12.6) shows that we have added a positive term to the “old” po- 
tential energy. 

By choosing sufficiently large feedback gains hi > 0, we may shape the poten- 
tial energy in such a way that it becomes positive definite. 



12.1.3 The Nonlinear PD-controller for Hamiltonian Systems 

If we want to stabilize a simple Hamiltonian system, then we should compose 
the two steps in the previous subsections: 

• first, we make the system stable by suitable shaping the potential energy, 
and 

• then asymptotically stabilize the system by adding damping to the new 
controls ty. 

Definition 12.1.1 (PD output feedback controller) 

The following proportional-derivative (PD) output feedback controller 

Ui = -hyi - cffi, hi > 0 , a > 0, i = l,...,m (12.7) 

is applied to simple Hamiltonian system models. 

The results in Subsections 12.1.1 and 12.1.2 show that the PD output feed- 
back controller above can locally asymptotically stabilize a simple Hamilto- 
nian system with sufficiently large fcj. The additional freedom in the choice 
of the gain parameters (fc,, c,, i = 1, . . . , m) can be used to ensure a satisfac- 
tory transient behavior (analogously to the classical PD-controller case for a 
linear second-order system). 

Properties of the PD Output Feedback Controller 

1. It is important to note that the nonlinear PD output feedback relates 
“corresponding” iq — y, pairs where y t is the natural output to the input 
Ui. Analogously to the linear case, standard controllability and observ- 
ability conditions should hold to ensure that we have “enough” inputs to 
achieve stabilization as m < n in the general case. 

2. Observe that the feedback (12.7) is only seemingly an output feedback 
because y, is the “natural” and not the real output of the system. Taking 
into account the definition of the natural output of simple Hamiltonian 
systems in Equations (8.33) and (8.31), it turns out that y,; depends on 
the state variables in a nonlinear way, therefore the feedback (12.7) is in 
fact a nonlinear state feedback. 
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12.1.4 Comparison of the Nonlinear PD-controller and Feedback 
Linearization 

If one compares the stabilization of a nonlinear system performed by feedback 
linearization or by the nonlinear PD-controller, the following points can be 
taken into account: 

1. Applicability range 

The applicability range of the two controllers is much different with little 
overlap. Feedback linearization requires systems with relative degree r = 
n or otherwise only approximative solutions may exist. The nonlinear 
PD-controller is only applicable to simple Hamiltonian systems but they 
include mechanical and process systems as well. 

2. Robustness 

Feedback linearization requires the exact knowledge of the nonlinear sys- 
tem dynamics and it is known to be very sensitive with respect to mis- 
modeling. The nonlinear PD-controller does only need the type of non- 
linearity but it is not sensitive with respect to the parameters. 

3. Computational resources 

The design of a nonlinear PD-controller does not require any computa- 
tional efforts while feedback linearization is rather demanding from the 
viewpoint of the design computations. 



12.2 Stabilization and Loop-shaping of Nonlinear 
Process Systems 

We have already seen how to develop the Hamiltonian system models of 
process systems in Section 8.6, where the system variables and the elements 
of the system Hamiltonian have been introduced. This Hamiltonian system 
model serves as the basis of stabilization and loop-shaping of process systems. 



12.2.1 Process Systems as Simple Hamiltonian Systems 

The basis of the Hamiltonian description of a process system is the con- 
struction described in Section 8.6. It has been shown that a process system 
with the input variables (4.12) as the flow rates, the state variables (8.60) 
as the conserved extensive quantities in each balance volume, and the co- 
state variables (8.61) as the related thermodynamical potentials, enables us 
to construct a simple Hamiltonian system model with the Hamiltonian func- 
tion (8.72) and with the underlying relationships (8.65), (8.68) and (8.62), 
(8.69). 

The following special properties of the elements of the Hamiltonian de- 
scription can be identified for process systems: 
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1. Internal Hamiltonian 

The internal Hamiltonian is related to the source term of the general 
conservation balances only, such that: 

Ho(q,p) = V Q (q), = -Q*{q) 

Therefore Ho(q,p) = 0 for process systems with no source. 

2. Coupling Hamiltonians 

Recall, that the Hamiltonian description assumes that the input variables 
are the flow rates of the system, i.e. Uj = Then it follows from the 
general state equation (8.68) that 

dH 

“X ~(q) = (NjQ I ) ij T B C onv,ij 

From this we see that the natural output is nonlinear and at most a 
quadratic function of the state variables q. 



12.2.2 Stabilization 

The stabilization of a Hamiltonian process system is then a simple application 
of the PD output feedback controller in Section 12.1.3, given in Equation 
(12.7). 

From this we can see that a process system can be stabilized by the 
nonlinear PD output feedback controller in the form of (12.7) if the following 
conditions hold: 

1. The system possesses a passive mass convection network (see in Subsec- 
tion 4.2.4). 

2. All of the flow rates are used for the feedback as input variables. 



12.3 Simple Process Examples 

This section illustrates the design of stabilization and loop-shaping controllers 
based on Hamiltonian system models using simple process examples intro- 
duced earlier in Chapter 4. A nonlinear PD output feedback controller is 
designed here for the bilinear heat exchanger cell and the free mass convec- 
tion network. 

12.3.1 Hamiltonian Control of the Heat Exchanger Cell 

The basic Hamiltonian description of the nonlinear heat exchanger cell model 
has already been developed in Subsection 8.8.2 from its state-space model 
described in Section 4.4, where the state and co-state variables have been 
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identified and the internal Hamiltonian Ho(q,p) has been derived in Equation 
(8.85). We only need to identify the coupling Hamiltonians H\(q) and H 2 (q) 
from the co-state equation (8.83) for the input variables 

u = [ v h - vl , v c -v*} T 

The coupling Hamiltonians can be reconstructed from the vector functions 
gi ( p ) and g 2 ( p ) respectively, which are the gradient vectors of the correspond- 
ing coupling Hamiltonians: 



dH x 8H 2 

= 9i{Q), -7Tr= 92(g) 



dq 



dq 



By partial integration, we have already obtained in Equations (8.86) and 
(8.87) that 



H\(q) = 2 Cph (T *) 2 Qi + cphT hi qi 
H 2 (q ) = ~ c Pc ( T*f ql + c Pc T ci q 2 



From passivity analysis we know that the system is inherently passive but 
that it has a pole at the stability boundary. Therefore we can perform stabi- 
lization by derivative feedback and loop-shaping by static feedback by using 
two nonlinear PD output feedback controllers as follows: 

(loop 1) 

mi = -hyi ~ ciy'i, ki > 0 , ci > 0 (12.8) 

V\ = (T*) 2 q\ + Cp ) T/ ( j( 7 1 

(loop 2) 

u 2 = -k 2 y 2 - c 2 y 2 , k 2 > 0 , c 2 > 0 (12-9) 

92 = 7 ,c ( p ] (T*) 2 q\ + c^T hi qi 



12.3.2 Loop-shaping Control of the Free Mass Convection 
Network 

Loop-shaping control of the free convection network described in Section 
4.2.4 is developed here. The simple Hamiltonian system model is the basis 
of the controller design which is described in Subsection 8.8.3 using the LTI 
state-space model of the free mass convection network in Equation (4.22). 

The state and co-state variables, which are the volume and the hydrostatic 
pressure in each balance volume, 



r W 1 ) ~r(C) 1 T 

q=[pgh pgh \ 
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r ttW 

P=[V 



F (c) 1 T 



have been identified and the internal Hamiltonian H 0 {q,p) has been derived 
in Equation (8.89). 

The coupling Hamiltonians can be derived from the co-state equations 
(8.88), taking into account that the input functions are the gradient vectors of 
the corresponding coupling Hamiltonians. We observe that an input variable 

u j = vfy acts only on its state variable qj = pgh^\ therefore 



hMj) 




hC?) 



From passivity analysis we know that the system is inherently passive with 
no poles at the stability boundary. Therefore we need not perform stabiliza- 
tion by a derivative output feedback but can perform loop-shaping by static 
feedback by using C pieces of P-controllers as follows: 

(loop j) 

Uj - —kjUj, kj > 0, yj = XjhW , Xj > 0 (12.10) 

The above separate static linear output feedback controllers perform pole- 
placement in a similar way to what we have seen in the case of pole-placement 
controllers (see Section 9.2) but now in the context of a MIMO setting as a 
non-optimal LQR (see Section 9.3). 



12.4 Stabilization of a Simple Unstable CSTR 

Consider the same unstable CSTR as in Section 8.8.4. There we described an 
isotherm CSTR with fixed mass hold-up m and constant physico-chemical 
properties. A second-order 



2 A + S -> T + 3A 

autocatalytic reaction takes place in the reactor where the substrate S is 
present in great excess. Assume that the inlet concentration of component 
A ( CAin ) is constant and that the inlet mass flow rate v is used as an input 
variable. The Hamiltonian description of the system has been given around 
its steady-state point determined as the setpoint for passivation and loop- 
shaping in Section 8.8.4. 

Now we develop a loop-shaping controller based on the Hamiltonian sys- 
tem model [30]. 
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12.4.1 System Parameters and Open- loop Response 

Let us introduce the normalized concentration variables c A = c A — c* A and 
CAin = CAin — c* A . The conservation balance equation (4.70) then takes the 
form 

d ^=k-C 2 A + ( 2 k-C*A--)-CA+ 5 Ain ~~ CA -U (12.11) 

at m m 

The parameter values used in the simulations are shown in Table 12.1. 
Table 12.1. Parameter values of the simulated CSTR 



Variable 


Value 


Unit 


m 


1800 


kg 


k 

CAin 


5 • 10~ 4 
0.4 


m 3 

kmol-s 

kmol 


ca 


2.3 


kmol 


V* 


2.5058 




kc 


10 


- 



There were two initial concentration values ( 0 , 4 ( 0 )) given for the simula- 
tions: 

• 1 Jsfl an d 

m° 

• 2.8 ^ 

m° 

respectively. 

It is easily seen from the data that c* A is an unstable equilibrium for the 
system as it is illustrated in both of the sub-figures in Figure 12.1. 

12.4.2 Nonlinear Proportional Feedback Controller 

Let us apply the following nonlinear proportional output feedback controller 

u = k c yi + w = k c ■ (^ c 2 a - c A i n ■ c A ) + w ( 12 . 12 ) 

where k c is an appropriately chosen controller gain and w is the new reference 
signal. The new reference w was set to 0 for the simulations. The chosen 
value of the controller gain is shown in Table 12.1 together with the system 
parameters. 

The closed-loop simulation results in Figure 12.2 show that the proposed 
control method indeed stabilizes the equilibrium c* A = 2.3 Here again, 
the simulation was performed using two different initial conditions as above 
as shown in the two sub-figures of Figure 12.2. 
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Figure 12.1. Open-loop simulation results 



12.4.3 Stability Region 

It is an important question for a nonlinear controller to determine its stability 
region as a function of the state variables with its parameter(s) fixed. For this 
very simple case this problem can be solved analytically. 

Let us consider the nonlinear proportional feedback controller above with 
its gain fixed at k c = 10. In fact, it is easy to show that the resulting closed- 
loop system with the parameters described above is passive with respect to 
the supply rate w • y if 

kmol 

ca > —1.9088 — 5 - i.e. ca > 0.3912 
nF 

where y = ca- 

In order to show this, let us take the simple storage function V (ca) = \c\- 
It can be calculated that 

dV . dV 

f(c A ) <0 if c A > -1.9088 (12.13) 

dc A OCA 

and equality holds only if ca = 0. Since g(cA) = 1 in the closed-loop state- 
space model we can deduce that 
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Figure 12.2. Closed-loop simulation results 



y = L g V{c A ) = qI-- g(c A ) = c A (12.14) 

where L g is the Lie-derivative of the simple storage function with respect to 
the function g. Therefore it follows that the closed-loop system is passive in 
the given interval. 

The time derivative of the storage function (as a function of c A ) is depicted 
in Figure 12.3. 



12.5 Hamiltonian Control of a Simple Continuous 
Fermenter 

The simple continuous fermenter is used as a case study for designing a 
nonlinear PD output feedback controller for a process system. The input- 
affine nonlinear state-space model of the fermenter is developed in Section 
4.5.3 and it is given in Equations (4.78)-(4.79). The variables and parameters 
of the fermentation process model are collected in Table 4.1. 
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Figure 12.3. Time derivative of the storage function as a function of ca 



12.5.1 Hamiltonian Model of the Fermentation Process 

Based on the input-affine state-space model, it is fairly easy to obtain the 
Hamiltonian system model of the fermentation process. For this, let us intro- 
duce the following variables: 



Pi 




m x 


- mx 0 




m x 


P'2_ 




_ m s 


- ms 0 . 




fh s _ 



( 12 . 15 ) 



q = 



Qi 

<72 



X 

s 



( 12 . 16 ) 



where p = —Vq denotes the centered component masses. The Hamiltonian 
form of the model is written as 



Pi = - V{X 0 - qi )n(S 0 - <72) + (X 0 - qi)F 0 + (X 0 - qi )F 

P 2 = V{X ° ~ qi y {S ° ~ Q2) - (S F - (S 0 - q 2 ))F 0 - (S F - (S Q - q 2 ))F 

Then the coupling Hamiltonian (natural output) used for feedback is calcu- 
lated by simple integration. Since 
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^=x 0 - qi , ^ = -(S F - (5o - ffii)) (12.17) 

agi oq2 

the natural output of the system is written as 

2/i = H x {q) = X o9l - igj _ ^ F q 2 - (S 0 g2 - ^gf)) (12.18) 

Note that the above natural output for feedback defines a nonlinear static 
full state feedback which is a quadratic function of both state variables. 

12.5.2 Full State Feedback Using the Whole Natural Output 

In this case, the feedback consists of the entire calculated natural output 

F = —kiyi = -ki(X 0 qi - ^qf - S F q 2 + S 0 q 2 - *g|) (12.19) 

where £q is an appropriately chosen positive constant. Again, we emphasize 
that both of the biomass and the substrate concentration is needed to realize 
the nonlinear static feedback above. This calls for the application of a possibly 
nonlinear state filter to determine the biomass concentration X which is 
hardly measurable. 

The simulation results corresponding to k\ = 0.5 are visible in Figure 
12.4. 



12.5.3 State Feedback Using Only a Part of the Natural Output 

It is known from the theory of Hamiltonian systems that the definiteness of 
the time derivative of the storage function (i.e. the stability of the closed- 
loop system) may be influenced by using only some part of the natural output 
for feedback. Since the biomass concentration is quite difficult to measure in 
practice, we choose the substrate concentration for feedback, i.e. 

F = —k 2 ■ — ( S F q 2 — (S 0 q 2 — (12.20) 

The simulation results for k 2 — 1 can be seen in Figure 12.5. As can be seen, 
the application of only one state variable is enough to stabilize the system 
in this case. Moreover, the quality of the control remains much the same as 
compared to the full state feedback case seen in Figure 12.4. 



12.5.4 Controller Tuning and Stability Analysis of the 
Closed-loop System 

A simple graphical method can be used for tuning the Hamiltonian controllers 
and investigating the stability region around a given operating point. The 
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Figure 12.4. Typical result of Hamiltonian control using the entire natural output: 
state variables and input 





Figure 12.5. Typical result of Hamiltonian control using the substrate concentra- 
tion only: state variables and input 
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method is applicable for systems where only one input variable with a scalar 
feedback gain k is applied. 

For the purpose of the analysis, the state-space form of the closed-loop 
system will be denoted by 

x = f{x) (12.21) 

where 

fix) = f{x) + g{x)i~ki ■ yi{x)) ( 12 . 22 ) 

First, we construct a simple quadratic storage function 

V{x) = ^ x T x (12.23) 

and examine the sign of its time derivative around the desired operating 
point. This storage function is clearly positive definite and it is a candidate 
for being a Lyapunov function of the system. 

The time derivative of the storage function is given by 

V{x) = -7 -V{x) = x T ■ x = x T f(x) (12.24) 

at 

where / is the right-hand side of the state-space model of the closed-loop 
system, which depends on the feedback gain k\. Then the idea is to choose 
the feedback gain in such a way that the above time derivative is negative 
definite over a wide operating region in the state-space. 

Hamiltonian Control with Full State Feedback. The time derivatives 
of the quadratic storage function as functions of the state variables X and 
S corresponding to the feedback gain k\ = 0.5 and k\ = 5 are shown in 
Figures 12.6. (a) and (b) respectively. It can be easily calculated that the 
desired operating point (a’o = [0, 0] T ) is a local maximum of V at V(xo) = 0. 
Therefore the proposed full state Hamiltonian feedback locally asymptotically 
stabilizes the desired operating point. If we have a look at Figure 12.6 again, 
we can see that the stability region is fairly wide around the operating point 
in both cases, since the sign of V is negative everywhere except the close 
neighborhood of the singularity points [X = 0, S = 5f] t and [X = 0, S ^ 
Sf] t ■ 

Hamiltonian Control with Partial State Feedback. If we apply the 
same storage function for stability analysis as in the previous case, we can 
again plot V as a function of the biomass and substrate concentrations. This 
can be seen in Figures 12.7. (a) and (b) corresponding to the feedback gains 
fci = 0.5 and k\ = 5 respectively. 

As can be seen, the system is again stable in a reasonable wide neigh- 
borhood of the operating point in these cases. This is in good agreement 
with what we expected from the simulation results, i.e. that using only the 
substrate concentration for nonlinear feedback is sufficient for stabilizing the 
system. 
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a 



b 



Figure 12.6. Time derivative of the quadratic Lyapunov function as a function of 
A' and S, Hamiltonian full state feedback, (a) fci = 0.5, (b) k\ = 5 





a 



b 



Figure 12.7. Time derivative of the quadratic Lyapunov function as a function of 
A' and S, Hamiltonian partial state feedback, (a) k\ = 5, (b) k\ = 5 



12.5.5 Discussion 

From the above cases, we can clearly see that the stabilizability region and 
the value of the feedback gain are closely related, therefore they should be 
investigated/designed jointly. The above proposed graphical method can be 
used for simultaneous feedback control gain selection and stabilization region 
determination. 



12.6 Further Reading 

The traditional and still main application area of Hamiltonian system mod- 
els and their physics-based control is in mechatronics (robots): see [65] for a 
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simple introductory paper. A good early survey of control based on Hamil- 
tonian system models in mechatronics is found in [52], while a recent paper 
on port-controlled Hamiltonian system is [51]. 

Process Systems. There is emerging literature in the field of making con- 
nections between thermodynamics and the theory of Hamiltonian systems for 
process control purposes. 

The principles of constructing a Hamiltonian control of process systems 
can be found in [30]. 

A survey of related papers is offered by Ydstie [83]. 



12.7 Summary 

A powerful robust method for stabilization and loop-shaping is presented in 
this chapter for nonlinear input-affine systems which enable a Hamiltonian 
system model. The stabilizing and loop-shaping controller is a proportional- 
derivative (PD) output feedback controller, which requires to feed back the 
artificial output related to each input. This controller in fact is a nonlinear 
static feedback controller, because both the artificial output and its time 
derivative are nonlinear static functions of the state variables. 

Process systems of different complexity, a heat exchanger cell, free mass 
convection networks, a simple unstable CSTR and a simple continuous fer- 
menter are used to demonstrate the use of the proposed PD output feedback 
controller on process systems. 



12.8 Questions and Application Exercises 

Exercise 12.8.1. Give the design parameters of the nonlinear PD output 
feedback controller design. Comment on the effect of these parameters on the 
properties of the closed-loop system. 

Exercise 12.8.2. What is the role of the proportional and the derivative 
part of the nonlinear PD output feedback controller? Give process system 
examples, when one of the parts is not needed. 

Exercise 12.8.3. Compare passivation by static feedback design described 
in Chapter 11 and stabilization and loop-shaping based on Hamiltonian sys- 
tem models. What are the similarities and the differences? 

Exercise 12.8.4. Characterize the nonlinearities that can occur in the non- 
linear PD output feedback controller when controlling process systems. What 
is the physical reason of this nonlinearity type? 
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Exercise 12.8.5. Compare the properties of the direct passivation controller 
presented in Section 11.3 and the Hamiltonian control of the same system 
in Section 12.5. Comment on the timing parameters, computational require- 
ments and on the stability region. 

Exercise 12.8.6. Construct a nonlinear PD output feedback controller for 
the ideal spring model developed in Example 8.3.1. 

Exercise 12.8.7. Consider a simple CSTR model developed in Subsection 
4.5.1 but with the reaction rate expression 

r = k ■ m • c\ 

Construct a nonlinear PD output feedback controller for this CSTR follow- 
ing the way for the stabilization of the simple unstable CSTR described in 
Subsection 12.4. 
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A.l Vector and Signal Norms 

If we have objects of non-scalar nature, for example vectors, matrices, func- 
tions or signals, we measure their magnitude by using norms. Norms are the 
extensions of a length of a vector applied to other objects of non-scalar nature 
forming a so called vector space. 

Definition A. 1.1 (Vector space) 

The set of elements X with the operation addition and multiplication by scalar 
is called a vector space if 

• if X\,X 2 €E X then x* = {x\ + X 2 ) € X 

• if X\ € X then x* = ax 1 £ X for any net 

• there is a zero element Xq £ X for which X\ + Xq = Xi holds for every 
X\ £ X 

Definition A. 1.2 (Norm on vector space) 

A scalar-valued function p(.) : X — > R is a norm on a vector space X if 

• p(x) >0 , \/x £ X 

• p(x) = 0 <t=> x = 0 £ X 

• p(x + y) < p( x) + p(y) (triangular inequality) 



A. 1.1 Vector Norms 

n-dimensional vectors with real- valued entries x = [x\, X 2 , • • • , x n ] form a 
vector space called R". There are different known and useful norms defined 
over the vector space R" which are as follows. 

Definition A. 1.3 (Vector norms) 

1. p-norm 




p ~ 



, p = 1,2,... 



(A.l) 
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2. Euclidean norm or 2-norm ( p = 2) 



F 2 = 



\N : 



3. maximum norm or oo-norm (jp — > oo) 



= maxi \Xj 



(A.2) 



(A.3) 



A. 1.2 Signal Norms 

Systems are usually described by differential equations which contain signals 
f from a signal space C (compare with Section 2.1) A signal my be scalar- 
valued, or vector-valued, i.e. : 

f(t) G n , F(t) G W 1 

for any fixed time instant t. We shall use two types of norms of a signal : the 
infinity norm and the 2-norm. 

Definition A. 1.4 (Signal norms) 

• p-norm 



/ poo \ 1 /p 

ii f \\p = {j i/wrj 

• 2-norm (j> = 2) 

/ OO nO O 

f(t) , \\F\\l= ||F(t)||l 

-oo J — OO 

• infinity norm {jp — > oo) 



I I/I loo = sup |/(0I 

t 



Halloo = sup | |^’(fc)|| 00 

t 



(A.4) 



(A.5) 



(A.6) 



A.2 Matrix and Operator Norms 



Definition A. 2.1 (Induced operator norm) 

The induced norm of an operator q on the vector space X induced by a norm 
||.|| on the same space is defined as 



ikii = sup 

lb’ll— t 



INI 



(A.7) 
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Matrices can be seen as linear operators transforming vectors from a vec- 
tor space like R n to another vector space which can be the same or a different 
one like M m . For rectangular matrices when m ^ n and T G R mxrl we h ave 
different vector spaces and for square matrices when n = m they are the 
same vector space. 

The ’’magnitude” of a matrix is also characterized by its norm. Similarly 
to the case of vectors and matrices there are various norms applicable for 
matrices. The most important ones are the so called induced norms where 
the matrix norm is derived using an already defined vector norm. 

Definition A. 2. 2 (Matrix norm, induced) 

The induced N-norm of a square matrix T G TZ nxn is defined as: 



||T|U = sup 
xeR n 



\\Tx\\ n 

IMk 



where | |-||jv is a vector norm. 



(A.8) 



A. 3 Lie-derivative, Lie-product 

The notion of Lie-derivative and Lie-product play central role in the geometric 
approach of nonlinear system analysis and control. 



A. 3.1 Lie-derivative 
Definition A. 3.1 (Lie-derivative) 

Let us given a nonlinear scalar-valued function A G R™ e- > R and a vector 
field f G R" i— > R" on a common domain U =dom(X) =dom(f) C R" open 
and let A be continuously differentiable, i.e. A G C 1 on U 
The derivative of A along f is defined as 

L fH x ) = = it, =< d H x )J( x ) > ( A -9) 

i— 1 



Observe that the vector field / in any point defines a direction along which 
we compute the derivative (gradient) of A. 

It is important to note that Lf A G M™ i— > R. The repeated Lie derivation is 
defined recursively: 



L) X(x) 



djL)- 1 X(x)) 
dx 



fi x ) 



(A.10) 



with L°j : A = A. 
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Example A. 3.1 (Simple Lie-derivatives) 



Two simple examples illustrate the above definition. 
1. one-dimensional example, i.e. i£t 



M x ) = 



f(x) = Vx 



Now we can compute both Lf A and L\f as follows: 
LfX(x) = 2x • a/z , L\f(x) = — ^ = • x 2 

LyJ X 



2. two-dimensional example, i£t 2 

\(xi,x 2 ) = x\, f(x i,x 2 ) = f{x) = 

and 

Lf \(xi,x 2 ) = 2xi(x 2 + x 2 ). 



X 2 + X 2 
X 1 + x 2 



A. 3. 2 Lie-product 



Lie-product is defined for two vector fields f,g £ R n i — > R n defined on a 
joint open domain U — dom(f) = dom(g) C R" where both / and g are 
continuously differentiable ( C 1 on U) 

Definition A. 3. 2 (Lie-product (Lie-bracket)) 

The Lie-product of f and g is defined as: 



lf,ff](z) = 


dg(x ) 

dx 


fi x ) - 


df(x) , ^ 
ax 


where 


r dgi(x) 


dgi(x) 


dgi(x) ' 


dg(x) _ 


dg 2 (x) 


dg 2 {x) 




dx\ 


dx 2 


* * ’ dx n 


dx 


dgn(x) 


dg„(x) 


dg„(x) 



L dxi dx2 ' ' ' dx n J 



(A.ll) 



(A.12) 



is the Jacobian matrix of the function g with respect to its independent vari- 
able x. 



Naturally, [/, g){x) £ R" which enables to apply the Lie-bracket operation 
repeatedly. 
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Important Properties of Lie-bracket. 

• Bilinearity over R 

fit fli 3l; 32 € t n '-'R", ri,f2 € R 

[nfi + r 2 f2,gi] = fi 1/1,51] + M/2,32] (A. 13) 

I/i,n5i + ^252] = ri[/i,5i] +r 2 [/i,5 2 ] (A.14) 

• Skew commutativity /, 5 G R 2 1 — > R" 

I/>3] = -[a,f] (A. 15) 

• Jacobi identity 

[/, \g,p\] + Is, \p, /]] + Ip, [/, 3]] = 0 (A. 16) 



The following simple examples show further important properties of Lie- 
bracket which are useful in process system applications. 



Example A. 3. 2 (Simple Lie-products) 



x\ + x\ 

3 1 


II 


-Xl 


Xi + X 2 


1 


x 2 



The following simple two-dimensional (1 € R 2 ) examples illustrate 
the definition of Lie-products. 

1. Two general vector fields / and g 

f(x) = 

gives the following Lie-product 
I/,3]0) = 

2. A constant vector field / with a general vector field g 



'-1 o' 




x\ + x\ 




2x\ 


2a; 2 




-xi 


0 1 




x\ + x\ 




3a; 2 


3a 




. X2 



, g(x) = 



/ 0 ) = 

gives the following Lie-product 

[7,g\(x) = 

where only the first term gf / is present. 



-Xi 

x 2 



-3 

2 
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3. Two constant vector fields / and g 

4 

5 

gives the following Lie-product 




because both || and are zero matrices. 



A. 4 Distributions, Co-distributions 

Distributions and co-distributions are important basic notions in the geomet- 
ric approach to analyzing dynamic properties of nonlinear systems, such as 
controllability and observability. 

A. 4.1 Distributions 
Definition A. 4.1 (Distribution) 

Consider a set of functions fi,. ■■ ,f d € 1" — > R" with joint domain U in 
R": 

U = dom(/!) =,...,= dom (f d ) C R" 

The distribution A spanned by the functions fi, ■ ■ ■ , f d 

A(x) =span {fi(x),...,f d (x)} (A. 17) 

assigns a vector space to each point x$ of U . 

In notation we omit the independent variables and write: 

A = span{/i, . . . , fd} (A. 18) 

Definition A. 4. 2 (Dimension of a distribution) 

The dimension of a distribution A at x is the dimension of the vector space 
spanned by A in x. 

Operations on Distributions. The following set-like operations are de- 
fined on distributions: 



( Ai + A 2 )(x) — Ai(: v) + A 2 (x ) 
(Ai n A 2 ){x) = A\(x) n A 2 {x) 



(A.19) 
(A. 20) 
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Obviously, if the distributions Z\i and A 2 are spanned by the functions 
(/ 1 , . . . , f n ) and g m ) respectively, then the distribution (Z\i + ZI 2 ) 

is spanned by 

(/ !)•••) /n; <?1> • • • 1 ) 



Distributions and their Properties. There are some notions and special 
distribution types which are important from practical point of view. 

• Nonsingular distribution A defined on U 

A is a nonsingular distribution if 3d G N such that 

dim(Z\(;r)) = d \/x G U (A. 21) 

• Regular point of a distribution A 

Xq is a regular point of distribution A if there exists a neighborhood U° 
of x° such that A is nonsingular on U°. 

• Point of singularity 

xs is a point of singularity if it is not a regular point. 

• / belongs to the distribution A (f G A) when 

f(x) G A(x) Mx (A. 22) 

• Distribution Ai contains a distribution A 2 (A\ D A 2 ) if 

Ai(x) D A 2 (x) \/x (A. 23) 

• Distribution A is involutive 

A distribution A is called involutive if 

Ti G A,t 2 G A =4- [tij T 2 ] G A (A. 24) 

• Distribution A is invariant under the vector field f when 

r G A => [/, r] G A (A. 25) 



The following simple examples show how to work with distributions. 
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Example A. 4.1 (Simple distribution) 



Consider a set of functions /-, 



R" — > R” such that 



0 

0 



fi = 



Xi 

0 



0 



where only the itli entry is non-zero for i = 1 , . . . , n. 
The dimension of the distribution 



A{x) = span{/ l7 . . . , /„} 

depends on the point x as follows. 

• dim(Z\(a;)) = n when Xi yf 0, i = 1, . . . , n 

• dim(Z\(a;)) = d < n when at least one of the entries of x is zero, 
i.e. Xi = 0 

• dim(Z\(a;)) = 0 if x = 0, i.e. in the origin of the space X 
Therefore A is nonsingular everywhere except 

'Dsing — {x \ Xi 0 , i — 1 , . . . , Tl\ 

The above set V S i ng contains all singular points of distribution A. 



A. 4. 2 Co-distributions 



Co-distributions are defined using the notions of dual space and co-vector 
fields which are as follows. 

Definition A. 4. 3 (Dual space of a vector space) 

Dual space V* of a vector space V C R" is the set of all linear real-valued 
functions defined on V. Formally defined as 



f(x) = f(x !,x 2 , ...,x n ) = a\X\ + a 2 x 2 H b a n x n 

ai € R, i = 1, . . . , n 



(A. 26) 



i.e. f(x) = ax where 
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a=[a 1 a 2 ... o„] 



Xi 

x 2 

x n 



(A. 27) 



Note that f is given by the row vector a. 

Definition A. 4. 4 (Co-vector field) 

A mapping from R” xl to R lxn is called a co-vector field. It can be represented 
row vector valued function. 



f(x) = f(x 1 ,x 2 , • • • ,x n ) = [fi{x) f 2 (x) ... f n { x)\ (A. 28) 



Example A. 4. 2 (Gradient, a special co-vector field) 



Let us define a co-vector field dX associated to a vector field A G 
R ra — » R. as follows: 



d\(x) 



dX(x) dX(x) dX(x) 

dx\ dx 2 dx n 



dX is called the gradient of A. 



(A. 29) 



Definition A. 4. 5 (Co-distribution) 

Let vj \, ... ,u> n be smooth co-vector fields. Then 12 is a co- distribution spanned 
by the co-vectors: 

I2(x) = span{a;i (a;), . . . , u>d{x)} (A. 30) 

At any point xq co- distributions are subspaces of (R™)*. 

We usually omit the argument of the co-vector fields and the co- distribution 
and write: 

f2 = span{wi, . . . , w>d\ (A. 31) 

Operations on Co-distributions and their Properties. Operations, 
such as addition, intersection, inclusion are defined in an analogue way 
to that of distributions. Likewise, the notion of the dimension of a co- 
distribution at a point, regular point, point of singularity are applied to 
co-distributions in an analogous way. 
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Special Co-distributions and their Properties. 

• Annihilator of a distribution A (A L ) 

The set of all co- vectors which annihilates all vectors in A(x). 

A^(x) = {u>* G (R")*| < w*,v >= 0 Wv G A(x)}. (A. 32) 

is called the annihilator of the distribution A. 

The annihilator of a distribution is a co-distribution. The annihilator of a 
smooth distribution is not necessarily smooth. 

• Annihilator of a co- distribution 17 (ft~ L ) 

I2 ± (x) = {v € R"| < w*,v >= 0 Ww* G l7(x)}. (A. 33) 

is the annihilator of a co-distribution 17. 

The annihilator of a co-distribution is a distribution. 

• Co- distribution invariant under the vector field f: 

The co-distribution 17 is invariant under the vector field / if and only if 

u G 17 => Lfw G 17 (A. 34) 

where (. Lfcj)(x ) = u(x) d g‘^ • 

• Sum of dimensions of a distribution and its annihilator 

dim(A) + dim(A ± ) = n (A. 35) 

• Inclusion properties 

Ax D A 2 Ax c A 2 (A. 36) 

• Annihilator of an intersection 

(Ax n A 2 ) ± = A^- + A 2 (A. 37) 

• Compatibility of the dimension of a distribution 

If a distribution A is spanned by the columns of a matrix F, the dimension 
of A at a point x° is equal to the rank of F(x°). If the entries of F are 
smooth functions of x then the annihilator of A is identified at each x G U 
by the set of row vectors w* satisfying the condition w*F( x) = 0. 

• Compatibility of the dimension of a co- distribution 

If a co-distribution 17 is spanned by the rows of a matrix W, whose entries 
are smooth functions of x, its annihilator is identified at each x by the set 
of vectors v satisfying W (x) = 0, i.e. 

f2 J ~(x) = ker(W(x )) . 

• Compatibility of the invariant property of annihilators 

If a smooth distribution A is invariant under the vector field /, then the 
co-distribution 17 = A 1 - is also invariant under /. 

If a smooth co-distribution 17 is invariant under the vector field /, then 
the distribution A = 17 _L is also invariant under /. 
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• Condition of involutivity 

A smooth distribution A = span{/i, . . . , f,i} is involutive if and only if 



G A VI <i,j <d. 



(A. 38) 
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Z/ 2 -gain, 20, 139 

- and storage function, 174 

- of linear systems, 139 

- of nonlinear systems, 139 
L q spaces, 15 

L q - gain, 20 

Lq-stability, 20 

g-norm, 15 

2-cell heat exchanger 

bilinear, controllability, 118 

affine Hamiltonian system model, 181 
annihilator 

- of a co-distribution, 296 

- of a distribution, 296 
asymptotic stability, see stability, 

asymptotic 

balance volume, 40 
BIBO stability, see stability, BIBO 
bifurcation analysis, 150 
bifurcation value, 151 
bilinear systems, 33 

- realization, 88 

- state-space model, 33 
binary distillation column CMO 

- model construction, 163, 164 

- stability analysis, conservation 
matrix, 163, 164 

binary distillation tray CMO 

- model construction, 162 
bounded- input- bounded-output 

stability, see stability, BIBO 

CARE, see control algebraic Ricatti 
equation 
case studies 

- 2-cell heat exchanger, 118 

binary distillation column CMO, 163, 
164 

binary distillation tray CMO, 162 



- continuous fermenter, 63, 92, 120, 
165, 219, 220, 242, 248, 257, 279 

- fed-batch fermenter, 61, 122 

- free mass convection network, 50, 
159, 160, 199, 275 

- gas turbine, 65, 259 

- heat exchanger cell, 55, 116, 161, 
195, 196, 274 

- heat exchanger network, 161 

- passive mass convection network, 51 

- simple evaporator, 52 

- unstable CSTR, 60, 200, 276 
causal system, 18 

centered variable, 47, 146, 185 
closed-loop system 

- zero dynamics, 254 
co-distribution, 294 

- annihilator of, 296 

- annihilator of a distribution, 296 

- invariant under a vector field, 296 

- observability, 111 
co-state variable, 177, 179 

- Hamiltonian equations, 218 

- LTI systems, 214 

- mechanical systems, 179 

- process systems, 190 
column conservation matrix, see 

conservation matrix 
conservation balances, 42, 44 
conservation matrix, 158 

binary distillation column CMO, 163, 
164 

- convection matrix, 50 

- free mass convection network, 159 
conserved extensive quantities, 42, 185, 

188, 190 

- moments, 179 

constant molar overflow, see CMO, 
binary distillation tray and column 
constitutive equations, 42, 45 
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- extensive-intensive relationship, 45, 
186 

- transfer rate equation, 46 

- transfer terms, 187 

continuous and discrete time systems, 
19 

continuous fermenter, 63 

- controllability analysis, 120 

- exact linearization, 242 

- input-output linearization, 243 

- input-output model, 81 

- linearized model, 65 

- LPV stability analysis, 167 

- LQR, 220 

- model construction, 63 

- optimal operating point, 64 

- output selection for feedback 
linearization, 248 

- PD output feedback controller, 279 

- pole-placement controller, 219 

- stability analysis, 165 

- stabilizing feedback controller, 257 

- zero dynamics, 92 
control aim, 206 

control algebraic Ricatti equation 
(CARE), 215 

control Lyapunov function, 255 
controllability, 99 

- input-affine nonlinear systems, 104 

- LTI systems, 99 
controllability analysis 

bilinear 2-cell heat exchanger, 118 
bilinear heat exchanger cell, 116 

- continuous fermenter, 120 

- fed-batch fermenter, 122 

- LTI heat exchanger cell, 116 
controllability distribution, 105 

algorithm for constructing, 106 

- total integration, 109 
controlled systems 

- Hamiltonian system model, 216 
controller 

- feedback linearization, 273 

- LQR, 212 

- PD output feedback, 272, 273 

- pole-placement, 210 

- stabilizing feedback, 256 

- state feedback, 210, 215, 230 
controller form realization of LTI 

systems, 28 
convection matrix, 50 
convolution 

- of signals, 13 



coordinate transformation 
linear, 26 

linear, effect on state matrix, 144 

- nonlinear, 32 , 104, 125, 230 
coordinates 

linearizing, 235 

DAE model, 40 

diagonal form realization of LTI 
systems, 27 
diffeomorphism 

- global, 33 
local, 33 

Dirac-<5 or unit impulse function, 10 
dissipative systems, see passive systems 
distribution, 292 

- annihilator of, 296 

- annihilator of a co-distribution, 296 

- invariant under a vector held, 293 

- involutive, 293 

- nonsingular, 293 

- regular point, 293 
dual space, 294 

engineering driving forces, 188 
equivalent realizations, 76 
equivalent state-space models, 26 
Euler-Lagrange equations, 178, 213 , 
218 

- LTI systems, 213 

exact linearization, 230 , 232 

- continuous fermenter, 242 

- output selection, 246 

- solution procedure, 234 
extensive variable, 43 
extensive-intensive relationship, see 

constitutive equations 
external stability, see stability, BIBO 

fed-batch fermenter, 61 

- controllability analysis, 122 

- minimal realization, 134 

- model construction, 61 

- nonlinear coordinate transformation, 
125 

feedback, 206 

- derivative output, 270 

- full, 207 

- general configuration, 140 
linear, 207 
linearizing, 235 

- output, 207 

- passivating, see passivating feedback 

- stabilizing, see stabilizing feedback 
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- state, 207 

- static, 207 

- static proportional output, 271 

- static state, 254 
feedback equivalence, 254 
finite dimensional systems, 24 
Fliess’s series expansion, 80 
formal power series, 78 

free mass convection network, 50 

- Hamiltonian system model, 199 

- model construction, 50 

- PD output feedback controller, 275 

- stability analysis, conservation 
matrix, 159 

- stability analysis, Lyapunov function, 
160 

gas turbine, 65 

- model construction, 65 

- stabilizing feedback controller, 259 
general decomposition theorem, 103 
general modeling assumptions, 40 
Gibbs-Duhem relationship, 185 

Hamilton-Jacobi inequality, 175 
Hamiltonian, 177, 180 

- internal, 180 

- internal and coupling, 180 

- mechanical systems, 180 

- nonlinear systems, 217 

- process systems, 192 
Hamiltonian control system, 179 
Hamiltonian description, see Hamilto- 
nian system model 

Hamiltonian equations, 218 
Hamiltonian function, see Hamiltonian 
Hamiltonian system model, 176 

- affine, 181 

- co-state variable, 177, 179 

- controlled systems, 216 

- free mass convection network, 199 

- heat exchanger cell, 196 

- mechanical systems, 177 
process systems, 190 

- simple, 182, 269 

- unstable CSTR, 200 
Hammerstein co-state differential 

equation, 214 
Hankel matrix 

- construction for nonlinear systems, 
86 

- LTI case, 85 

- nonlinear systems, 86 



heat exchanger cell, 55 

- 2-cell heat exchanger, 118 
bilinear, controllability, 116 
bilinear, observability, 117 

- Hamiltonian system model, 196 

- Hankel matrix of the bilinear model, 
89 

- LTI model, 57 

- LTI, controllability, 116 

- LTI, observability, 116 

- LTV model, 58 

- model construction, 55 

- nonlinear model, 58 

- PD output feedback controller, 274 

- storage function, 195 
heat exchanger network 

- model construction, 161 

- structural stability analysis, 162 
higher-order nonlinear differential 

equations representation, 81 

impulse- response function, 74 
impulse-response function, 75 
indistinguishable states, see observabil- 
ity 

inner product 

- of signals, 12 

input-output linearization, 238 

- continuous fermenter, 243 

- output selection, 246 
input-output model, 73 

- continuous fermenter, 81 

- LTI systems, 73 
input-affine nonlinear systems, 32 

- asymptotic stability, 143 

- controllability, 104 

- controllability form realization, 104 

- observability, 110 

- state-space model, 32 
intensive variable, 43 
internal stability, see stability, 

asymptotic 

irreducible transfer function, 101 
iterated integrals, 78 

joint controllability and observability 

- LTI systems, 100 

Lagrangian, 178 
Lagrangian control system, 179 
Lagrangian function, see Lagrangian 
Legendre transform, 179, 180 
Lie-derivative, 289 
Lie-product (Lie-bracket), 290 
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linear parameter- varying systems, see 
LPV systems 

Linear Quadratic Regulator, see LQR 
linear system, 19 
linear systems 

- Z/ 2 -gain, 139 

linear time- varying parameter systems, 
see LTV systems 
linearization 

- exact linearization, 232 

- input-output linearization, 238 

- of nonlinear state-space models, 
local, 146 

linearizing coordinates, 235 
linearizing feedback, 235 
LPV systems, 29 

- affine, 30 

- asymptotic stability, 155 

- polytopic, 30 

- stability of a continuous fermenter, 
167 

LQR, 212 

- continuous fermenter, 220 

- LTI systems, 212 
LTI systems, 19, 25 

- asymptotic stability, 143 

- BIBO stability, 138 

- co-state variable, 214 

- controllability, 99 

- controller form realization, 28 

- diagonal form realization, 27 

- Euler-Lagrange equations, 213 

- general decomposition theorem, 103 

- impulse-response function, 74 

- input-output model, 73 

- joint controllability and observability, 
100 

- linear differential equation model, 74 

- LQR, 212 

- Lyapunov theorem, 154 

- minimal realization, 101 

- observability, 98 

- pole-placement controller, 210 

- realization theory, 82 

- relationship between BIBO and 
asymptotic stability, 144 

- relative degree, 229 

- state-space model, 25 

- structural equivalence, 157 

- transfer function, 28, 75 
LTV systems, 28 

lump, see balance volume 



Lyapunov criterion, see Lyapunov 
theorem 

LPV systems, 167 
Lyapunov function, 153 

- as storage function, 176 

- control, 255 
dissipativity, 153 

free mass convection network, 160 
Lyapunov theorem, 153 
LPV systems, 155 
LTI systems, 154 

Markov parameters, 36, 77 , 83 
matrix norm, induced, 289 
mechanical systems 

- co-state variables, 179 

- conserved quantities, 179 

- equation of motion in Hamiltonian 
formulation, 179 

- equations of motion, 177 
Hamiltonian, 180 
Hamiltonian system model, 177 

- state-space model, 178 
mechanisms, 41 

- chemical reaction, 41 

- convection, 41 

- phase changes, 41 

- transfer, 41 
MIMO systems, 19 
minimal realization 

- fed-batch fermenter, 134 
LTI systems, 101 

- nonlinear systems, 114 
minimum-phase nonlinear systems, 92 
model construction 

- binary distillation column CMO, 163, 
164 

- binary distillation tray CMO, 162 

- continuous fermenter, 63 

- fed-batch fermenter, 61 

free mass convection network, 50 

- gas turbine, 65 

heat exchanger cell, 55 
heat exchanger network, 161 

- passive mass convection network, 51 

- simple evaporator, 52 

- unstable CSTR, 60 
multi-index, 78 

nonlinear systems, 31 

- L 2 -gain, 139 

- asymptotic stability, 142 

- bilinear, 33, 88 
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- finite dimensional, 31 

- Fliess’s series expansion, 80 

- Hamiltonian, 217 

- Hamiltonian system model, 176 

- Hankel matrix, 86 
liigher-order nonlinear differential 
equations representation, 81 

- input-output representation, 78 

- input-affine, 32 

- linearization, 146 

- minimal realization, 114 

- minimum-phase, 92 
quadratically stabilizable, 155 

- realization theory, 85 

- total integration, 109 

- Volterra series representation, 80 
norm 

- of matrices, induced, 289 

- of operators, induced, 288 

- of signals, 288 

- of vectors, 287 

- on vector space, 287 

observability, 98 

- indistinguishable states, 110 

- input-affine nonlinear systems, 110 

- LTI systems, 98 

- nonlinear, local, 110 

- observation space, 110 
observability co-distribution, 111 

- algorithm for constructing, 111 
observation space, see observability 
Onsager relationship, 188 
operator norm, induced, 288 
output equation, 24 

output feedback, 207 
derivative, 270 

- proportional-derivative (PD), 272 

- static, proportional, 271 

passivating feedback, 254 
passivation, 253 

- passivating feedback, 254 
passive mass convection network, 51 

- model construction, 51 
passive systems, 175 

- process systems, 189 

PD output feedback controller, 272 

- continuous fermenter, 279 

- free mass convection network, 275 
heat exchanger cell, 274 

- unstable CSTR, 276 
pole-placement controller, 210 , 276 



- continuous fermenter, 219 
process systems 

bilinear, 51 

- co-state variables, 190 

- decomposed state equation, 48 

- Gibbs-Duhem relationship, 185 

- Hamiltonian, 192 

- Hamiltonian system model, 190 

- maximal relative degree, 239 

- passivity analysis, 189 

- potential input variables, 47 

- state vector, 46 

- storage function, 186 

- system variables, 185, 190 

quadratically stabilizable systems, 155 

reachability, see controllability 
realization, 82 

- LTI systems, 82 

- nonlinear systems, 85 
relationship between transfer function 

and impulse-response function, 76 
relative degree, 91, 227 

- of LTI systems, 229 
Ricatti equation 

- control algebraic, CARE, 215 

- matrix differential, MARE, 214 
row conservation matrix, see conserva- 
tion matrix 

signal norms, 288 
signals, 7 
bounded, 10 

- convolution, 13 

- Dirac-<5 function, 10 

- discrete time, continuous time, 9 

- elementary operations, 12 

- inner product, 12 

- real valued, complex valued, 9 

- time shifting, 12 

- truncation, 13 

- unit step function, 11 
signed structure matrix, 157 
simple evaporator, 52 

- model construction, 52 

simple Hamiltonian system model, 182, 
269 

SISO systems, 19 
small-gain theorem, 140 
stability 

- Z/ 2 -gain, 139 

- asymptotic, 142 
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- asymptotic, input-affine nonlinear 
systems, 143 

- asymptotic, LTI systems, 143 

- asymptotic, nonlinear systems, 142 

- BIBO, 138 

binary distillation column CMO, 
structural, 163, 164 

- continuous fermenter, 165 

- heat exchanger network, structural, 
162 

- LTI BIBO, 138 

- Lyapunov theorem, general, 153 

- Lyapunov theorem, LTI systems, 154 

- quadratically stabilizable systems, 
155 

- relationship between BIBO and 
asymptotic, 144 

- structural, 157 
stability matrix, 143 

- conservation matrix, 158 
stabilizing feedback controller, 256 

- continuous fermenter, 257 

- gas turbine, 259 
state, 24 

state controllability, see controllability 
state equation, 24 

- of process systems, 48 

- truncated, 142 
state feedback, 207 

- linear, 210, 215 

- nonlinear, 230 

state observability, see observability 
state-space exact linearization problem, 
see exact linearization 
state-space model, 24 

- LPV systems, 29 

- LTI systems, 25 

- LTV systems, 28 

- nonlinear input-affine systems, 32 

- structurally equivalent, 157 
state-space models related by state 

transformation 

- LTI systems, 26 
state-space representation, see 

state-space model 
steady-state reference point, 146 
storage function, 140, 174 



- and 1,2-gain, 174 

- as Lyapunov function, 176 

- available storage, 174 
Hamiltonian system model, 176 
heat exchanger cell, 195 

- process systems, 186 
structural stability, 157 
structure matrix, 157 

- signed, 157 
systems, 17 

- L 9 -stability and L q - gain, 20 

- causal, 18 

- continuous and discrete time, 19 
linear, 19 

- SISO and MIMO, 19 

- time-invariant, 19 

thermodynamical potentials, 185 , 188, 
190 

time shifting 

- of signals, 12 
time-invariant system, 19 
Toeplitz matrix, 211 
topological equivalence, 150 

total integration of nonlinear systems, 
109 

transfer function, 28, 75 
transfer rate equation, see constitutive 
equations 

truncated state equation, 142 
truncation 

- of signals, 13 

unit step function, 11 
unstable CSTR, 60 

Hamiltonian system model, 200 

- model construction, 60 

PD output feedback controller, 276 

vector norms, 287 
vector space, 287 

- dual space, 294 

Volterra series representation, 80 

zero dynamics, 90 , 238 

- closed-loop system, 254 

- continuous fermenter, 92 




